-- Logs begin at Fri 2022-07-29 04:24:37 UTC, end at Fri 2022-07-29 05:42:24 UTC. -- Jul 29 05:11:39.072205 dv-cinder-851279-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 29 05:11:39.081970 dv-cinder-851279-2-iscsi devstack@n-api.service[103217]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 29 05:11:39.083891 dv-cinder-851279-2-iscsi devstack@n-api.service[103217]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 29 05:11:39 2022] *** Jul 29 05:11:39.083891 dv-cinder-851279-2-iscsi devstack@n-api.service[103217]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 29 05:11:39.083891 dv-cinder-851279-2-iscsi devstack@n-api.service[103217]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 29 05:11:39.083891 dv-cinder-851279-2-iscsi devstack@n-api.service[103217]: nodename: dv-cinder-851279-2-iscsi Jul 29 05:11:39.083891 dv-cinder-851279-2-iscsi devstack@n-api.service[103217]: machine: x86_64 Jul 29 05:11:39.083891 dv-cinder-851279-2-iscsi devstack@n-api.service[103217]: clock source: unix Jul 29 05:11:39.083891 dv-cinder-851279-2-iscsi devstack@n-api.service[103217]: pcre jit disabled Jul 29 05:11:39.083891 dv-cinder-851279-2-iscsi devstack@n-api.service[103217]: detected number of CPU cores: 4 Jul 29 05:11:39.083891 dv-cinder-851279-2-iscsi devstack@n-api.service[103217]: current working directory: / Jul 29 05:11:39.083891 dv-cinder-851279-2-iscsi devstack@n-api.service[103217]: detected binary path: /usr/bin/uwsgi-core Jul 29 05:11:39.083891 dv-cinder-851279-2-iscsi devstack@n-api.service[103217]: your processes number limit is 47680 Jul 29 05:11:39.084643 dv-cinder-851279-2-iscsi devstack@n-api.service[103217]: your memory page size is 4096 bytes Jul 29 05:11:39.084643 dv-cinder-851279-2-iscsi devstack@n-api.service[103217]: detected max file descriptor number: 2048 Jul 29 05:11:39.084643 dv-cinder-851279-2-iscsi devstack@n-api.service[103217]: lock engine: pthread robust mutexes Jul 29 05:11:39.084643 dv-cinder-851279-2-iscsi devstack@n-api.service[103217]: thunder lock: enabled Jul 29 05:11:39.084643 dv-cinder-851279-2-iscsi devstack@n-api.service[103217]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 29 05:11:39.084643 dv-cinder-851279-2-iscsi devstack@n-api.service[103217]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 29 05:11:39.122743 dv-cinder-851279-2-iscsi devstack@n-api.service[103217]: Python main interpreter initialized at 0x5612285349c0 Jul 29 05:11:39.122743 dv-cinder-851279-2-iscsi devstack@n-api.service[103217]: python threads support enabled Jul 29 05:11:39.122743 dv-cinder-851279-2-iscsi devstack@n-api.service[103217]: your server socket listen backlog is limited to 100 connections Jul 29 05:11:39.122743 dv-cinder-851279-2-iscsi devstack@n-api.service[103217]: your mercy for graceful operations on workers is 90 seconds Jul 29 05:11:39.124202 dv-cinder-851279-2-iscsi devstack@n-api.service[103217]: mapped 403077 bytes (393 KB) for 2 cores Jul 29 05:11:39.124202 dv-cinder-851279-2-iscsi devstack@n-api.service[103217]: *** Operational MODE: preforking *** Jul 29 05:11:39.124202 dv-cinder-851279-2-iscsi devstack@n-api.service[103217]: *** uWSGI is running in multiple interpreter mode *** Jul 29 05:11:39.124202 dv-cinder-851279-2-iscsi devstack@n-api.service[103217]: spawned uWSGI master process (pid: 103217) Jul 29 05:11:39.124230 dv-cinder-851279-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 29 05:11:39.125154 dv-cinder-851279-2-iscsi devstack@n-api.service[103217]: spawned uWSGI worker 1 (pid: 103218, cores: 1) Jul 29 05:11:39.125154 dv-cinder-851279-2-iscsi devstack@n-api.service[103217]: spawned uWSGI worker 2 (pid: 103219, cores: 1) Jul 29 05:11:39.125388 dv-cinder-851279-2-iscsi devstack@n-api.service[103217]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 29 05:11:39.793542 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 29 05:11:39.822232 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 29 05:11:40.961543 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 05:11:40.961543 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: from cryptography.utils import int_from_bytes Jul 29 05:11:40.962811 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 05:11:40.962811 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: from cryptography.utils import int_from_bytes Jul 29 05:11:41.057835 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 05:11:41.057835 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: from cryptography.utils import int_from_bytes Jul 29 05:11:41.058461 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 05:11:41.058461 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: from cryptography.utils import int_from_bytes Jul 29 05:11:43.631253 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 29 05:11:43.632245 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 29 05:11:43.632245 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 29 05:11:43.632512 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 29 05:11:43.632643 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 29 05:11:43.632932 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.633259 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.633585 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.633903 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.634241 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.634585 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.634880 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.635195 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.635557 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.635857 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.636145 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.636467 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851279-2-iscsi {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.636797 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.637107 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.637413 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.637740 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.638041 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.639083 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.639540 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.640050 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.640491 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.640805 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.641124 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.641459 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.641921 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.642123 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.642394 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.642703 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.643030 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.643340 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.643777 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851279-2-iscsi {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.644099 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.644413 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.644728 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.645158 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.645471 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.645782 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.646106 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.646490 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.646745 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.647071 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.647531 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.647745 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.648070 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.648371 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.649433 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.649433 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.649433 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.649842 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.650040 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.650197 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.650407 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.650731 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.651052 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.651141 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 29 05:11:43.651662 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 29 05:11:43.651765 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.651765 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.651985 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.652124 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 29 05:11:43.652225 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.652314 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 29 05:11:43.652489 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 29 05:11:43.652625 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.652801 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.652999 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.653132 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.653308 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.653432 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.653614 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.654436 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.654585 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.654761 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.654901 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.655157 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.655474 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.655802 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.656122 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.656443 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.656677 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.656848 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.656993 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.657135 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.657285 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.657448 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.657590 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.657755 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.657928 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.658116 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.658345 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.658540 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.658762 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.658954 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.659129 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851279-2-iscsi {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.659272 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.659500 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.659649 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.659851 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.660003 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.660183 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.660342 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.660526 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.660686 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.660882 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.661031 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.661242 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.661444 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.661444 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.661814 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.662023 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.662023 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.662400 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.662639 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.662857 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.663081 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.663231 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.663455 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.663650 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.663829 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.663829 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.664127 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.664282 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.664490 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.664645 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.664808 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.664901 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.664901 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.665179 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.665283 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.665385 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.665589 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.666010 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.666181 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.666353 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.666564 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.666564 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.666830 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851279-2-iscsi {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.666906 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.667035 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.667120 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.667120 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.667456 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.667588 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.667751 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.667910 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.668089 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.668249 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.668449 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.668593 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.668713 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.668941 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.669116 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.669269 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.669537 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.669685 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.669844 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.670114 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.670259 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.670447 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.670447 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.670447 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.670827 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.670915 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.671127 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.671274 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.671485 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.671657 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.671771 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.671885 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.672046 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.672238 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.672358 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.672453 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.672590 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.672768 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.672922 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.673041 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.673214 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.673351 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.673498 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.673631 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.673822 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.673988 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.674128 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.674298 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.674442 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.674597 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.674750 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.674904 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.674904 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.675174 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.675332 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.675505 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.675680 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.675814 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.675980 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.676116 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.676258 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.676414 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.676559 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.676753 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.676965 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.677109 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.677255 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.677413 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.677555 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.677710 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.677851 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.677994 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.678137 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.678292 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.678438 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.678570 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.678709 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.678872 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.679072 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.679243 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.679491 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.679631 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.679771 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.679910 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.680071 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.680212 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.680346 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.680497 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.680740 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.680889 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.681092 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.681204 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.681314 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.681405 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.681486 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.681577 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.681706 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.681852 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.681939 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.682112 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.682252 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.682409 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.682601 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.682773 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.682902 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.683022 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.683152 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.683278 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.683464 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.683578 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.683719 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.683886 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.684112 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.684383 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.684525 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.684683 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.684858 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.685049 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.685230 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.685230 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.685632 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.685632 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.685901 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.686130 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.686281 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.686444 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.686600 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.686743 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.686935 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.687144 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.687301 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.687492 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.687639 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.687796 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.687949 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.688091 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.688244 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.688386 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.688529 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.688686 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.688825 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.688978 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.689162 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.689282 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.689379 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.689491 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.689683 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.689784 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.689916 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.690041 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.690265 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.690448 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.690583 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.690905 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.691014 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.691217 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.691312 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.691568 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.691687 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.691883 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.691989 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.692195 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.692284 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.692501 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.692599 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.692811 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.692973 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.693107 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.693240 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.693412 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.693558 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.693742 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.693904 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.694124 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.694290 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.694459 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.694586 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.694699 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.694907 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.695046 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.695160 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.695288 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.695538 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.695683 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.695880 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.696090 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.696241 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.696385 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.696540 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.696697 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.696840 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.696985 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.697126 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.697348 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.697499 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.697686 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.697904 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.698070 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.698161 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.698331 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.698493 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.698619 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.698745 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.698880 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.699018 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.699159 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.699297 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.699464 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.699614 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.699792 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.699957 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.700136 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.700304 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.700459 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.701280 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.701463 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:11:43.701637 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.701786 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.702199 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.702199 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.702199 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.702635 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.702820 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.702989 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.703171 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.703320 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.703583 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.703736 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.703934 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.703934 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.704276 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.704420 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.704582 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.704582 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.704968 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.705168 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.705359 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.705359 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.705686 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.705834 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.706013 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.706185 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.706363 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.706523 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.706714 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.706862 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.707039 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.707203 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.707336 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.707575 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.707715 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.707887 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.708152 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.708358 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.708512 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.708673 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.708820 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.708942 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.709088 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.709212 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.709353 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.709544 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.709689 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.709829 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.709829 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.710107 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.710200 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.710335 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.710451 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.710542 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.710639 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.710721 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.710871 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.710998 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.711086 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.711211 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.711301 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.711401 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.711471 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.711552 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.711552 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.711691 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.711849 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.711948 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.712160 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.712277 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.712474 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.712594 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.712792 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.712927 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.713096 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.713240 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.713433 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.713556 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.713745 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.713878 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.714040 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.714162 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.714334 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.714588 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.714738 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.714901 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.715014 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.715126 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.715322 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.715559 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.715685 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.715819 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.715968 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.716136 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.716971 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.717107 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.717297 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.717483 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.717835 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.718063 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.718261 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.718408 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.718596 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.718745 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.718888 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.719028 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.719187 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.719338 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.719512 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.719710 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.719884 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.720045 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.720045 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.720300 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.720300 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.720544 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.720676 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.720843 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.720983 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.721120 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.721262 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.721404 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.721547 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.721705 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.721847 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.721989 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.722129 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.722270 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.722414 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.722577 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.722724 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.722871 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.723018 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.723161 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.723319 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.723580 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.723724 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.723855 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.723985 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.724132 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.724307 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.724456 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.724615 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.724758 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.724900 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.725049 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.725210 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.725366 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.725511 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.725651 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.725794 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.725946 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.726089 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.726245 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.726385 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.726520 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.726662 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.726817 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.726961 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.727102 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.727237 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.727397 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.727522 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.727665 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.727808 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.727965 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.728111 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.728256 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.728400 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.728560 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.728765 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.728919 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.729079 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.729223 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.729370 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.729561 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.729767 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.730077 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.730604 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.730938 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.731252 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.731582 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.731916 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.732467 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.732876 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.733113 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.733380 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.733582 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.733812 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.733947 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.734094 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.734217 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.734422 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.734604 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.734743 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.735002 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.735219 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.735554 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.735706 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.735856 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.736003 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.736181 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.736306 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.736406 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.736595 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.736733 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.736909 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.737044 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.737275 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.737598 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.737920 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.738054 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.738297 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.738400 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.738579 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.738713 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.738984 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.739149 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.739285 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.739412 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.739554 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.739850 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.740041 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.740265 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.740530 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.740628 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.740868 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.741043 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.741227 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.741376 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.741566 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.741694 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.741836 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.741932 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.742115 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.742199 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.742424 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.742543 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.742777 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.742937 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.743134 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.743227 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.743482 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.743606 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.743823 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.743993 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.744099 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.744208 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.744436 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.744615 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.744786 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.745040 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.745181 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.745356 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.745505 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.745650 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.745778 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.745994 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.746136 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.746311 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.746689 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.746689 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.747054 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.747269 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.747552 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.747702 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.747839 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.747839 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.748123 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.748123 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.748459 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.748637 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.748764 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.749114 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.749280 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.749419 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.749582 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.749726 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.749871 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.750020 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.750173 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.750304 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.750481 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.750610 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.750736 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.750881 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.751072 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.751222 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.751462 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.751627 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.751803 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.751947 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.752076 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.752213 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.752343 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.752474 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.752604 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.752742 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.752875 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.753005 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.753113 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.753320 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.753487 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.753640 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.753766 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.753902 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.754028 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.754402 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.754568 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.754766 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.754862 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.754933 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.755019 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.755240 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.755405 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.755596 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.755722 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.755867 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.756004 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.756196 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.756395 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.756514 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.756604 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.756804 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.756983 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.757201 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.757315 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.757438 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.757541 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.757781 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.757889 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.758094 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.758239 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.758393 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.758566 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.758740 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.758899 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.759029 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.759118 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.759336 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.759502 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.759639 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.759750 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.759911 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.760050 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.760187 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.760319 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.760481 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.760637 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.760801 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.760948 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.761091 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.761246 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.761389 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.761555 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.761713 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.761868 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.762015 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.762161 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.762305 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.762457 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.762598 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.762738 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.762872 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.763013 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.763834 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.764006 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.764175 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.764499 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.764821 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.764972 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.765119 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.765303 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.765450 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.765601 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.765750 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.765912 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.766053 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.766209 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.766353 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.766496 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.766642 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.766776 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.766943 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.767083 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.767222 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.767412 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.767651 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.767759 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.768004 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.768217 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.768364 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.768479 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.768683 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.768803 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.768983 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.769161 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.769343 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.769503 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.769652 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.769816 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.770015 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.770181 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.770364 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.770522 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.770666 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.770822 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.770988 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.771149 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.771311 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.771528 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.771661 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.771791 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.771934 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.772060 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.772187 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.772313 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.772439 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.772626 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.772992 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.772992 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.773305 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.773446 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.773593 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.773757 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.773925 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.774071 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.774224 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.774360 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.774496 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.774640 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.774823 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.774919 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.775023 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.775096 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.775172 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.775262 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.775440 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.775590 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.775720 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.775906 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.776042 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.776215 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.776358 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.776541 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.776672 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.776859 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.777003 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.777156 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.777298 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.777439 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.777580 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.777751 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.777925 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.778130 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.778271 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.778366 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.778478 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.778813 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.779539 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.779818 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.779992 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.780173 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.780334 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.780536 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.780763 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.780932 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.781097 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.781275 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.781427 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.781619 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.781783 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.781973 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.782063 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.782144 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.782221 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.782302 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.782529 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.782633 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.782813 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.782960 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.783152 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.783334 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.783525 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.783664 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.783822 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.783965 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.784110 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.784265 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.784406 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.784601 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.784811 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.785020 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.785179 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.785363 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.785508 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.785652 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.785804 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.785948 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.786106 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.786274 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.786419 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.786563 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.786563 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.786829 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.786987 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.787162 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.787306 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.788500 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.789299 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.789503 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.789653 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.789819 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.789952 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.790119 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.790251 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.790382 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.790525 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.790953 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.791108 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.791248 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.791248 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.791248 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.791248 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.791248 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.791972 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.792103 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.792231 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.792370 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.792370 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.792654 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.792654 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.792978 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.793149 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.793308 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.793484 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.793633 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.793810 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.793960 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.794137 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.794360 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.794579 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.794730 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.794913 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.795173 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.795394 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.795597 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.795777 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.795933 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.795933 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.796233 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.796366 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.796527 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.796707 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.796707 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.797024 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.797178 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.797481 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.797628 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.797798 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.797935 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.798081 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.798259 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.798406 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.798406 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.798713 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.798858 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.799007 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.799148 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.799397 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.799581 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.799722 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.799912 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.800060 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.800264 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.800413 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.800550 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.800649 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.800733 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.800864 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.801004 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.801094 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.801227 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.801389 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.801537 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.801717 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.801852 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.801969 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.802040 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.802107 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.802107 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.802237 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.802358 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.802487 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.802592 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.802704 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.802850 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.803006 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.803137 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.803213 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.803213 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.803333 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.803425 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.803507 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.803578 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.803657 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.803789 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.803967 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.804067 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.804149 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.804407 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.804510 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.804717 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.804862 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.805024 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.805247 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.805421 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.805592 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.805734 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.805836 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.805913 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.806101 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.806238 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.806374 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.806506 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.806700 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.806862 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.807032 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.807179 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.807319 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.807576 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.807721 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.807881 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.808027 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.808166 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.808311 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.808459 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.808605 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.808775 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.808925 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.809073 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.809220 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.809350 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.809491 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.809644 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.809787 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.810001 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.810142 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.810291 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.810484 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.810632 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.810776 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.811069 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.811221 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.811402 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.811616 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.811770 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.811947 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.812105 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.812250 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.812394 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.812542 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.812663 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.812804 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.812949 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.813092 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.813239 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.813408 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.813551 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.813708 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.813851 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.813990 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.814133 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.814285 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.814509 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.814691 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.814830 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.814965 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.815107 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.815282 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.815482 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.815653 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.815808 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.815972 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.816123 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.816273 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.816444 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.816595 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.816746 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.816899 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.817047 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.817185 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.817336 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.817474 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.817611 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.817744 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.817896 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.818036 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.818196 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.818341 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.818496 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.818638 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.818787 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.818932 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.819075 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.819249 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.819547 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.819721 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.819814 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.819897 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.819997 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.820200 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.820289 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.820503 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.820598 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.820827 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.820928 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.821127 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.821248 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.821450 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.821560 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.821778 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.821890 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.822087 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.822196 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.822414 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.822514 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.822733 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.822856 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.823047 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.823167 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.823377 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.823517 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.823698 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.823843 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.824014 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.824166 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.824328 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.824490 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.824719 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.824912 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.825054 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.825194 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.825339 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.826194 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.826364 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.826532 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.826668 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.826785 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.827067 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.827173 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.827460 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.827583 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.827819 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.827924 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.828127 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.828255 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.828463 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.828629 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.828780 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.828938 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.829104 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.829252 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.829394 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.829618 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.829786 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.829978 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.830130 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.830310 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.830464 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.830660 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.830770 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.830853 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.830939 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.831065 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.831254 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.831419 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.831589 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.831805 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.832050 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.832161 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.832275 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.832358 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.832552 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.832791 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.832930 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.833059 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.833193 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.833342 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.833505 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.833634 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.833763 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.833891 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.834245 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.834489 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.834489 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.834947 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.835125 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.835252 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.835252 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.835568 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.835710 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.835847 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.835974 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.836126 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.836306 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.836521 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.836700 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.836842 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.837036 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.837198 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.837347 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.837537 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.837683 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.837857 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.837988 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.838132 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.838274 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.838478 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.838654 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.838798 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.838987 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.839155 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.839371 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.839512 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.839643 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.839839 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.839839 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.840164 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.840308 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.840457 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.840649 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.840801 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.840979 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.841129 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.841974 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.842185 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.842382 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.842559 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.842810 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.843195 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.843452 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.843597 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.843597 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.843886 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.844034 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.844230 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.844380 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.844561 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.844711 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.844878 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.844996 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.845213 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.845375 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.845547 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.845718 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.845895 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.846024 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.846167 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.846279 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.846351 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.846456 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.846628 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.846628 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.846822 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.846946 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.847065 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.847137 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.847228 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.847462 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.847632 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.847750 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.847867 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.847995 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.848071 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.848151 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.848221 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.848316 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.848450 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.848560 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.848686 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.848930 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.849084 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.849259 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.849397 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.849604 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.849793 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.849931 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.850028 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.850171 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.850355 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.850532 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.850688 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.850806 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.850918 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.851100 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.851215 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.851450 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.851681 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.851826 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.851983 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.852122 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.852318 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.852480 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.852634 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.852777 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.852916 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.853055 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.853198 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.853336 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.853477 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.853629 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.853772 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.853911 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.854068 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.854231 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.854380 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.854529 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.854675 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.854820 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.854966 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.855121 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.855265 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.855431 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.855573 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.855710 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.855849 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.856010 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.856204 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.856353 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.856515 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.856672 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.857266 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.857563 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.857710 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.857860 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.858011 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.858011 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.858269 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.858415 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.858561 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.858708 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.858869 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.859018 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.859018 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.859310 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.859533 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.859672 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.859841 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.859989 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.860177 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.860331 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.860331 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.860668 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.860807 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.860944 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.861039 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.861148 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.861223 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.861362 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.861487 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.861697 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.861859 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.862031 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.862205 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.862352 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.862475 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.862588 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.862735 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.862917 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.863135 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.863263 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.863503 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.863675 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.863820 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.863959 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.864106 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.864289 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.864498 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.864633 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.864781 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.864931 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.865073 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.865221 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.865419 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.865596 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.865771 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.865951 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.866133 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.866335 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.866437 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.866584 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.866772 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.866907 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.867011 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.867171 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.867330 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.867537 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.867681 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.867810 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.867958 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.868134 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.868296 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.868493 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.868688 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.868854 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.869046 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.869208 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.869392 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.869569 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.869722 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.869868 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.870092 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.870288 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.870416 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.870530 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.870530 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.870682 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.870819 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.870914 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.871122 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.871246 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.871470 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.871691 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.871886 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.872031 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.872174 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.872312 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.872878 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.873081 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.873081 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.873392 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.873540 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.873673 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.873803 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.873803 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.874131 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.874307 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.874485 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.874632 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.874813 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.875006 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.875158 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.875303 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.875529 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.875711 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.875905 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.876056 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.876247 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.876482 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.876643 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.876809 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.877001 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.877151 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.877328 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.877505 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.877684 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.877832 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.877976 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.878159 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.878308 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.878563 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.878705 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.878872 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.878998 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.879215 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.879380 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.879534 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.879683 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.879823 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.879982 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.880117 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.880265 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.880397 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.880397 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.880675 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.880806 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.880936 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.881054 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.881182 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.881364 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.881618 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.881743 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.881872 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.881999 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.882116 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.882245 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.882370 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.882492 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.882618 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.882728 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.882849 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.882981 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.883100 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.883218 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.883333 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.883512 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.883628 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.883812 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.883942 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.884074 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.884194 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.884309 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.884424 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.884549 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.884692 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.884841 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.884987 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.885134 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.885298 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.885432 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.885575 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.885751 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.885904 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.886077 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.886245 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.886391 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.886603 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.886755 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.886900 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.887046 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.887204 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.887382 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.887531 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.887677 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.887823 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.887967 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.888762 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.888911 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.889142 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.889295 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.889440 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.889759 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.890044 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.890197 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.890390 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.890541 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.890686 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.890851 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.890995 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.891150 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.891310 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.891485 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.891632 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.891807 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.891953 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.892093 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.892232 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.892383 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.892570 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.892739 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.892950 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.893097 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.893240 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.893398 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.893565 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.893712 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.893925 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.894077 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.894225 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.894370 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.894531 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.894680 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.894827 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.894976 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.895107 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.895249 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.895418 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.895566 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.895716 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.895861 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.895998 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.896141 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.896274 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.896402 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.896545 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.896769 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.896931 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.897125 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.897273 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.897420 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.897566 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.897710 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.897858 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.898020 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.898229 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.898383 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.898518 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.898649 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.898797 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.898944 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.899092 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.899239 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.899484 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.899636 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.899803 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.899952 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 29 05:11:43.900096 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.900096 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.900433 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.900750 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.901058 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.901488 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.901816 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.902222 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.902550 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.902873 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.903201 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.903628 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.903998 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.904559 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.905031 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.905389 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.905737 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.906069 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.906399 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.906708 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.907015 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.907322 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.907660 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.907979 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.908287 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.908590 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.908892 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.909200 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.909583 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.909894 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.910201 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.910527 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.910834 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.911137 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.911463 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.911774 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.912076 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.912379 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.912682 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.912991 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.913377 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.913689 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.913995 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.914323 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.914626 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.914961 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.915295 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.915634 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.916214 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.916525 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.916847 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.917155 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.917557 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.917884 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.918206 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.918529 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.918868 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.919180 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.920183 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.920628 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.920980 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.921368 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.921767 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.922113 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.922461 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.922772 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.923127 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.923604 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.923851 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.924177 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.924510 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.924848 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.925157 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.925545 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.925864 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.926205 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.926518 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.926833 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.927145 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.927483 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.927805 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.928123 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.928454 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.928787 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.929124 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.929496 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.929840 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.930204 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.930595 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.930947 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.931273 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.931665 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.932043 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.932355 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:11:43.932597 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 29 05:11:44.064697 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO dbcounter [None req-29d4e4b0-4aca-46bb-937c-f22187762f63 None None] Registered counter for database nova_api Jul 29 05:11:44.089165 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG oslo_db.sqlalchemy.engines [None req-29d4e4b0-4aca-46bb-937c-f22187762f63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103218) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 05:11:44.097117 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO dbcounter [None req-ea4e7516-6881-4b56-ac2a-436188a37f2a None None] Registered counter for database nova_api Jul 29 05:11:44.097786 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG dbcounter [-] [103218] Writer thread running {{(pid=103218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 05:11:44.120101 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG oslo_db.sqlalchemy.engines [None req-ea4e7516-6881-4b56-ac2a-436188a37f2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103219) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 05:11:44.128725 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG dbcounter [-] [103219] Writer thread running {{(pid=103219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 05:11:44.177209 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.context [None req-29d4e4b0-4aca-46bb-937c-f22187762f63 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2(cell1) {{(pid=103218) load_cells /opt/stack/nova/nova/context.py:464}} Jul 29 05:11:44.182517 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG oslo_concurrency.lockutils [None req-29d4e4b0-4aca-46bb-937c-f22187762f63 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:11:44.184706 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG oslo_concurrency.lockutils [None req-29d4e4b0-4aca-46bb-937c-f22187762f63 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:11:44.186350 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG oslo_concurrency.lockutils [None req-29d4e4b0-4aca-46bb-937c-f22187762f63 None None] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:11:44.188738 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG oslo_concurrency.lockutils [None req-29d4e4b0-4aca-46bb-937c-f22187762f63 None None] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:11:44.190993 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO dbcounter [None req-29d4e4b0-4aca-46bb-937c-f22187762f63 None None] Registered counter for database nova_cell0 Jul 29 05:11:44.192550 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.context [None req-ea4e7516-6881-4b56-ac2a-436188a37f2a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2(cell1) {{(pid=103219) load_cells /opt/stack/nova/nova/context.py:464}} Jul 29 05:11:44.199238 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG oslo_concurrency.lockutils [None req-ea4e7516-6881-4b56-ac2a-436188a37f2a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:11:44.199522 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO dbcounter [None req-29d4e4b0-4aca-46bb-937c-f22187762f63 None None] Registered counter for database nova_cell1 Jul 29 05:11:44.199671 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG oslo_concurrency.lockutils [None req-ea4e7516-6881-4b56-ac2a-436188a37f2a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:11:44.199848 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG oslo_concurrency.lockutils [None req-ea4e7516-6881-4b56-ac2a-436188a37f2a None None] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:11:44.203868 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG oslo_concurrency.lockutils [None req-ea4e7516-6881-4b56-ac2a-436188a37f2a None None] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:11:44.206194 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO dbcounter [None req-ea4e7516-6881-4b56-ac2a-436188a37f2a None None] Registered counter for database nova_cell0 Jul 29 05:11:44.206591 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG oslo_db.sqlalchemy.engines [None req-29d4e4b0-4aca-46bb-937c-f22187762f63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103218) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 05:11:44.211410 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG oslo_db.sqlalchemy.engines [None req-29d4e4b0-4aca-46bb-937c-f22187762f63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103218) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 05:11:44.212534 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO dbcounter [None req-ea4e7516-6881-4b56-ac2a-436188a37f2a None None] Registered counter for database nova_cell1 Jul 29 05:11:44.213039 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG dbcounter [-] [103218] Writer thread running {{(pid=103218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 05:11:44.221006 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG oslo_db.sqlalchemy.engines [None req-ea4e7516-6881-4b56-ac2a-436188a37f2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103219) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 05:11:44.228673 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG dbcounter [-] [103219] Writer thread running {{(pid=103219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 05:11:44.229651 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG oslo_db.sqlalchemy.engines [None req-ea4e7516-6881-4b56-ac2a-436188a37f2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103219) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 05:11:44.369885 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG dbcounter [-] [103218] Writer thread running {{(pid=103218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 05:11:44.382477 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO dbcounter [None req-29d4e4b0-4aca-46bb-937c-f22187762f63 None None] Registered counter for database nova_cell0 Jul 29 05:11:44.391229 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG dbcounter [-] [103219] Writer thread running {{(pid=103219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 05:11:44.395886 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG oslo_db.sqlalchemy.engines [None req-29d4e4b0-4aca-46bb-937c-f22187762f63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103218) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 05:11:44.401968 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO dbcounter [None req-ea4e7516-6881-4b56-ac2a-436188a37f2a None None] Registered counter for database nova_cell0 Jul 29 05:11:44.402940 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG dbcounter [-] [103218] Writer thread running {{(pid=103218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 05:11:44.412099 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG oslo_db.sqlalchemy.engines [None req-ea4e7516-6881-4b56-ac2a-436188a37f2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103219) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 05:11:44.419082 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG dbcounter [-] [103219] Writer thread running {{(pid=103219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 05:11:44.790329 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: WARNING keystonemiddleware.auth_token [None req-29d4e4b0-4aca-46bb-937c-f22187762f63 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 05:11:44.799279 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: WARNING keystonemiddleware.auth_token [None req-29d4e4b0-4aca-46bb-937c-f22187762f63 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 05:11:44.805007 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: WARNING keystonemiddleware.auth_token [None req-ea4e7516-6881-4b56-ac2a-436188a37f2a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 05:11:44.813727 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: WARNING keystonemiddleware.auth_token [None req-ea4e7516-6881-4b56-ac2a-436188a37f2a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 05:11:45.180998 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: WARNING keystonemiddleware.auth_token [None req-ea4e7516-6881-4b56-ac2a-436188a37f2a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 05:11:45.181205 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: WARNING keystonemiddleware.auth_token [None req-29d4e4b0-4aca-46bb-937c-f22187762f63 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 05:11:45.188627 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: WARNING keystonemiddleware.auth_token [None req-ea4e7516-6881-4b56-ac2a-436188a37f2a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 05:11:45.189632 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: WARNING keystonemiddleware.auth_token [None req-29d4e4b0-4aca-46bb-937c-f22187762f63 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 05:11:45.194221 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5612285349c0 pid: 103219 (default app) Jul 29 05:11:45.195276 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5612285349c0 pid: 103218 (default app) Jul 29 05:11:45.197184 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-ea4e7516-6881-4b56-ac2a-436188a37f2a None None] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:11:45.198429 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-ea4e7516-6881-4b56-ac2a-436188a37f2a None None] 10.222.0.49 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001990 Jul 29 05:11:45.200260 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 788 bytes} [Fri Jul 29 05:11:45 2022] GET /compute/v2.1/ => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:13:08.381217 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-29d4e4b0-4aca-46bb-937c-f22187762f63 None None] Calling method '>' {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:13:08.382532 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.requestlog [None req-29d4e4b0-4aca-46bb-937c-f22187762f63 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002070 Jul 29 05:13:08.383142 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: [pid: 103218|app: 0|req: 1/2] 10.222.0.49 () {54 vars in 930 bytes} [Fri Jul 29 05:13:08 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:13:08.399101 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG dbcounter [-] [103219] Writing DB stats nova_api:SELECT=3 {{(pid=103219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:13:08.400122 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG dbcounter [-] [103219] Writing DB stats nova_cell0:SELECT=3 {{(pid=103219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:13:08.401453 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG dbcounter [-] [103219] Writing DB stats nova_cell1:SELECT=3 {{(pid=103219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:13:08.402290 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG dbcounter [-] [103219] Writing DB stats nova_cell0:SELECT=3 {{(pid=103219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:13:09.335968 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-a01a837f-5335-492f-99f6-c37e2b4a56c1 admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:13:09.372536 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-a01a837f-5335-492f-99f6-c37e2b4a56c1 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.982195 Jul 29 05:13:09.373317 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 2/3] 10.222.0.49 () {60 vars in 1291 bytes} [Fri Jul 29 05:13:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:13:11.713320 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-29d4e4b0-4aca-46bb-937c-f22187762f63 None None] Calling method '>' {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:13:11.714468 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.requestlog [None req-29d4e4b0-4aca-46bb-937c-f22187762f63 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002078 Jul 29 05:13:11.715142 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: [pid: 103218|app: 0|req: 2/4] 10.222.0.49 () {54 vars in 930 bytes} [Fri Jul 29 05:13:11 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:13:12.205189 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-e0358c34-fc1d-4bec-8d83-686918a3211f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 256, "vcpus": 1, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:13:12.226618 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 05:13:12.226618 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: warnings.warn(msg) Jul 29 05:13:12.260837 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-e0358c34-fc1d-4bec-8d83-686918a3211f admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.538804 Jul 29 05:13:12.268844 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 3/5] 10.222.0.49 () {64 vars in 1282 bytes} [Fri Jul 29 05:13:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 05:13:12.672251 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-b12d20c7-3251-46c4-85bd-17ac3244e791 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:13:12.679428 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 05:13:12.679428 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: warnings.warn(msg) Jul 29 05:13:12.684465 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG dbcounter [-] [103218] Writing DB stats nova_api:SELECT=3 {{(pid=103218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:13:12.685720 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG dbcounter [-] [103218] Writing DB stats nova_cell0:SELECT=3 {{(pid=103218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:13:12.687232 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG dbcounter [-] [103218] Writing DB stats nova_cell1:SELECT=3 {{(pid=103218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:13:12.688508 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG dbcounter [-] [103218] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:13:12.816475 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.requestlog [None req-b12d20c7-3251-46c4-85bd-17ac3244e791 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.545103 Jul 29 05:13:12.817171 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: [pid: 103218|app: 0|req: 3/6] 10.222.0.49 () {64 vars in 1335 bytes} [Fri Jul 29 05:13:12 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:13:15.096913 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-e0358c34-fc1d-4bec-8d83-686918a3211f admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:13:15.098055 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-e0358c34-fc1d-4bec-8d83-686918a3211f admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003558 Jul 29 05:13:15.098844 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 4/7] 10.222.0.49 () {54 vars in 930 bytes} [Fri Jul 29 05:13:15 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:13:15.865975 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-4cb6b9ed-207d-40d8-b4ca-02671f389bef admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "id": "d1", "ram": 512, "swap": 0}} {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:13:15.887137 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 05:13:15.887137 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: warnings.warn(msg) Jul 29 05:13:15.909263 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.requestlog [None req-4cb6b9ed-207d-40d8-b4ca-02671f389bef admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.802708 Jul 29 05:13:15.910248 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: [pid: 103218|app: 0|req: 4/8] 10.222.0.49 () {64 vars in 1282 bytes} [Fri Jul 29 05:13:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 05:13:15.924965 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-fba9989b-c0c2-40f0-b847-3ff9617f9bdc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:13:15.928873 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 05:13:15.928873 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: warnings.warn(msg) Jul 29 05:13:15.967145 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-fba9989b-c0c2-40f0-b847-3ff9617f9bdc admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047461 Jul 29 05:13:15.974844 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 5/9] 10.222.0.49 () {64 vars in 1335 bytes} [Fri Jul 29 05:13:15 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:13:18.297390 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-4cb6b9ed-207d-40d8-b4ca-02671f389bef admin admin] Calling method '>' {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:13:18.298406 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.requestlog [None req-4cb6b9ed-207d-40d8-b4ca-02671f389bef admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 29 05:13:18.299053 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: [pid: 103218|app: 0|req: 5/10] 10.222.0.49 () {54 vars in 930 bytes} [Fri Jul 29 05:13:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:13:18.710900 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-19957943-72d2-4b5a-b03d-1e07215101c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 1024, "vcpus": 1, "swap": 0, "disk": 10}} {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:13:18.730395 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-19957943-72d2-4b5a-b03d-1e07215101c3 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.425196 Jul 29 05:13:18.730978 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 6/11] 10.222.0.49 () {64 vars in 1282 bytes} [Fri Jul 29 05:13:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 05:13:18.742798 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-7f9ec8d1-e3b7-4a9e-b6c9-6604170ccaa6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:13:18.766736 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.requestlog [None req-7f9ec8d1-e3b7-4a9e-b6c9-6604170ccaa6 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027425 Jul 29 05:13:18.767231 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: [pid: 103218|app: 0|req: 6/12] 10.222.0.49 () {64 vars in 1335 bytes} [Fri Jul 29 05:13:18 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:13:21.064426 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-19957943-72d2-4b5a-b03d-1e07215101c3 admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:13:21.065617 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-19957943-72d2-4b5a-b03d-1e07215101c3 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001598 Jul 29 05:13:21.066067 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 7/13] 10.222.0.49 () {54 vars in 930 bytes} [Fri Jul 29 05:13:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:13:21.570622 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-5ea72834-6fbf-4e6d-b98e-4a9ee7dcc93b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "id": "d3", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "swap": 0, "rxtx_factor": 1.0, "name": "ds2G"}} {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:13:21.592046 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.requestlog [None req-5ea72834-6fbf-4e6d-b98e-4a9ee7dcc93b admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.518694 Jul 29 05:13:21.592591 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: [pid: 103218|app: 0|req: 7/14] 10.222.0.49 () {64 vars in 1282 bytes} [Fri Jul 29 05:13:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 05:13:21.605374 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-6f17fb96-b1a0-44b2-94a2-2524481bb496 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:13:21.630790 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-6f17fb96-b1a0-44b2-94a2-2524481bb496 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029661 Jul 29 05:13:21.633861 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 8/15] 10.222.0.49 () {64 vars in 1335 bytes} [Fri Jul 29 05:13:21 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:13:23.922749 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-5ea72834-6fbf-4e6d-b98e-4a9ee7dcc93b admin admin] Calling method '>' {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:13:23.924686 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.requestlog [None req-5ea72834-6fbf-4e6d-b98e-4a9ee7dcc93b admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jul 29 05:13:23.926695 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: [pid: 103218|app: 0|req: 8/16] 10.222.0.49 () {54 vars in 930 bytes} [Fri Jul 29 05:13:23 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:13:24.425825 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-6cf60298-75af-49cf-9239-5d1c6c7e3448 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "swap": 0, "ram": 4096, "disk": 20, "rxtx_factor": 1.0, "vcpus": 4, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:13:24.445934 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-6cf60298-75af-49cf-9239-5d1c6c7e3448 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.514167 Jul 29 05:13:24.446884 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 9/17] 10.222.0.49 () {64 vars in 1282 bytes} [Fri Jul 29 05:13:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 05:13:24.464405 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-81f18f76-f4c8-41f7-bedf-e01d1acf1013 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:13:24.499660 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.requestlog [None req-81f18f76-f4c8-41f7-bedf-e01d1acf1013 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042997 Jul 29 05:13:24.503437 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: [pid: 103218|app: 0|req: 9/18] 10.222.0.49 () {64 vars in 1335 bytes} [Fri Jul 29 05:13:24 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:13:26.840094 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-6cf60298-75af-49cf-9239-5d1c6c7e3448 admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:13:26.841014 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-6cf60298-75af-49cf-9239-5d1c6c7e3448 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jul 29 05:13:26.841361 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 10/19] 10.222.0.49 () {54 vars in 930 bytes} [Fri Jul 29 05:13:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:13:27.373059 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-2994050e-ca24-406f-8789-53e996d15f86 admin admin] Calling method '>' {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:13:27.401954 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.requestlog [None req-2994050e-ca24-406f-8789-53e996d15f86 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.554367 Jul 29 05:13:27.402508 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: [pid: 103218|app: 0|req: 10/20] 10.222.0.49 () {60 vars in 1291 bytes} [Fri Jul 29 05:13:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:13:30.241610 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-6cf60298-75af-49cf-9239-5d1c6c7e3448 admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:13:30.242701 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-6cf60298-75af-49cf-9239-5d1c6c7e3448 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001621 Jul 29 05:13:30.243175 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 11/21] 10.222.0.49 () {54 vars in 930 bytes} [Fri Jul 29 05:13:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:13:30.818679 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-29c0f0a5-60ab-443e-a48d-4a5b892fce04 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 512, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "1"}} {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:13:30.844920 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.requestlog [None req-29c0f0a5-60ab-443e-a48d-4a5b892fce04 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.594195 Jul 29 05:13:30.845464 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: [pid: 103218|app: 0|req: 11/22] 10.222.0.49 () {64 vars in 1282 bytes} [Fri Jul 29 05:13:30 2022] POST /compute/v2.1/flavors => generated 402 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 05:13:30.858737 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-1054ade4-3ee8-4cd1-87ad-f317e9ed456a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:13:30.889093 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-1054ade4-3ee8-4cd1-87ad-f317e9ed456a admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033857 Jul 29 05:13:30.890085 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 12/23] 10.222.0.49 () {64 vars in 1332 bytes} [Fri Jul 29 05:13:30 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:13:33.456099 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-29c0f0a5-60ab-443e-a48d-4a5b892fce04 admin admin] Calling method '>' {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:13:33.457421 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.requestlog [None req-29c0f0a5-60ab-443e-a48d-4a5b892fce04 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001736 Jul 29 05:13:33.457939 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: [pid: 103218|app: 0|req: 12/24] 10.222.0.49 () {54 vars in 930 bytes} [Fri Jul 29 05:13:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:13:33.956187 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-193d7df4-c4f7-4602-88a1-b502c7960476 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "vcpus": 1, "ram": 2048, "id": "2", "rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:13:33.976558 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-193d7df4-c4f7-4602-88a1-b502c7960476 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.510786 Jul 29 05:13:33.977140 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 13/25] 10.222.0.49 () {64 vars in 1282 bytes} [Fri Jul 29 05:13:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 05:13:33.994492 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-0bca81e0-a7e5-427e-86f7-eb401e304377 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:13:34.020923 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.requestlog [None req-0bca81e0-a7e5-427e-86f7-eb401e304377 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030754 Jul 29 05:13:34.021606 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: [pid: 103218|app: 0|req: 13/26] 10.222.0.49 () {64 vars in 1332 bytes} [Fri Jul 29 05:13:33 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:13:36.416227 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-193d7df4-c4f7-4602-88a1-b502c7960476 admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:13:36.417874 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-193d7df4-c4f7-4602-88a1-b502c7960476 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003276 Jul 29 05:13:36.423779 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 14/27] 10.222.0.49 () {54 vars in 930 bytes} [Fri Jul 29 05:13:36 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:13:37.219371 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-29df03c1-bb39-4de2-9d82-927cdcd12a25 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "id": "3", "disk": 40, "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 2, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:13:37.254002 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.requestlog [None req-29df03c1-bb39-4de2-9d82-927cdcd12a25 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.828291 Jul 29 05:13:37.254792 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: [pid: 103218|app: 0|req: 14/28] 10.222.0.49 () {64 vars in 1282 bytes} [Fri Jul 29 05:13:36 2022] POST /compute/v2.1/flavors => generated 406 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 05:13:37.276957 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-d7045ee0-cbef-4581-8c0a-10a2e33348b6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:13:37.323468 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-d7045ee0-cbef-4581-8c0a-10a2e33348b6 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.053350 Jul 29 05:13:37.339613 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 15/29] 10.222.0.49 () {64 vars in 1332 bytes} [Fri Jul 29 05:13:37 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:13:40.420197 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-29df03c1-bb39-4de2-9d82-927cdcd12a25 admin admin] Calling method '>' {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:13:40.422065 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.requestlog [None req-29df03c1-bb39-4de2-9d82-927cdcd12a25 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002105 Jul 29 05:13:40.422626 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: [pid: 103218|app: 0|req: 15/30] 10.222.0.49 () {54 vars in 930 bytes} [Fri Jul 29 05:13:40 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:13:41.100565 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-66770ecf-ecd8-4e9f-b2ed-3514ed0c54bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "disk": 80, "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.large", "ram": 8192}} {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:13:41.108120 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG dbcounter [-] [103219] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:13:41.126508 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-66770ecf-ecd8-4e9f-b2ed-3514ed0c54bc admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.696991 Jul 29 05:13:41.127404 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 16/31] 10.222.0.49 () {64 vars in 1282 bytes} [Fri Jul 29 05:13:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 05:13:41.143782 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-6e1b320e-c26b-49e4-8112-4867dcdd1f82 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:13:41.193521 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.requestlog [None req-6e1b320e-c26b-49e4-8112-4867dcdd1f82 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.056007 Jul 29 05:13:41.203386 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: [pid: 103218|app: 0|req: 16/32] 10.222.0.49 () {64 vars in 1332 bytes} [Fri Jul 29 05:13:41 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:13:43.636276 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-66770ecf-ecd8-4e9f-b2ed-3514ed0c54bc admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:13:43.637947 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-66770ecf-ecd8-4e9f-b2ed-3514ed0c54bc admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002111 Jul 29 05:13:43.638361 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 17/33] 10.222.0.49 () {54 vars in 930 bytes} [Fri Jul 29 05:13:43 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:13:44.169886 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-881539e9-7460-4308-95f1-21549cdd04e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "os-flavor-access:is_public": true, "disk": 160, "name": "m1.xlarge", "rxtx_factor": 1.0, "id": "5", "vcpus": 8, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:13:44.179027 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG dbcounter [-] [103218] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=103218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:13:44.200263 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.requestlog [None req-881539e9-7460-4308-95f1-21549cdd04e4 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.554873 Jul 29 05:13:44.201195 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: [pid: 103218|app: 0|req: 17/34] 10.222.0.49 () {64 vars in 1282 bytes} [Fri Jul 29 05:13:43 2022] POST /compute/v2.1/flavors => generated 408 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 05:13:44.214629 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-708015f9-c0d1-430e-b49e-d035147541a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:13:44.248834 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-708015f9-c0d1-430e-b49e-d035147541a3 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038339 Jul 29 05:13:44.249532 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 18/35] 10.222.0.49 () {64 vars in 1332 bytes} [Fri Jul 29 05:13:44 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:14:03.056988 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-881539e9-7460-4308-95f1-21549cdd04e4 admin admin] Calling method '>' {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:14:03.058005 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.requestlog [None req-881539e9-7460-4308-95f1-21549cdd04e4 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jul 29 05:14:03.058417 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: [pid: 103218|app: 0|req: 18/36] 10.222.0.49 () {54 vars in 930 bytes} [Fri Jul 29 05:14:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:14:03.069056 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG dbcounter [-] [103219] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:14:03.461592 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-5c1c2feb-24a1-4532-90cd-c4b54ec38855 admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:14:03.480081 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-5c1c2feb-24a1-4532-90cd-c4b54ec38855 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.415327 Jul 29 05:14:03.480672 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 19/37] 10.222.0.49 () {60 vars in 1291 bytes} [Fri Jul 29 05:14:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:14:04.564976 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-881539e9-7460-4308-95f1-21549cdd04e4 admin admin] Calling method '>' {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:14:04.565985 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.requestlog [None req-881539e9-7460-4308-95f1-21549cdd04e4 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Jul 29 05:14:04.566384 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: [pid: 103218|app: 0|req: 19/38] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Jul 29 05:14:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:14:05.142177 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-a9a8e1db-cc4f-42c4-9cef-6084a5f3a857 admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:14:05.147902 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.wsgi [None req-a9a8e1db-cc4f-42c4-9cef-6084a5f3a857 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 29 05:14:05.151227 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-a9a8e1db-cc4f-42c4-9cef-6084a5f3a857 admin admin] Request method failure captured: Jul 29 05:14:05.151227 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 29 05:14:05.151227 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: Accept: application/json Jul 29 05:14:05.151227 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: Accept-Encoding: gzip, deflate Jul 29 05:14:05.151227 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: Connection: keep-alive Jul 29 05:14:05.151227 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: Content-Length: 0 Jul 29 05:14:05.151227 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: Host: 10.222.0.49 Jul 29 05:14:05.151227 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: Openstack-Api-Version: compute 2.90 Jul 29 05:14:05.151227 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: Openstack-System-Scope: None Jul 29 05:14:05.151227 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: User-Agent: python-novaclient Jul 29 05:14:05.151227 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Auth-Token: gAAAAABi42ycVOUdL3WZ7SFbFt8FkFfqyhI3c8c0iLXls9i0jIdrzrH_cddg881JY3WbMtvBC9mn3CjceyFfuIvuFxJUQ-yheC_HtcOOYZ5ubxXB7oAyZFOmuGpH-j513p0KoENAARxYmL8YOcMTFOjD3q5Y3yTBna6a6Ja_xQGzwDGg854XYKM Jul 29 05:14:05.151227 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Domain-Id: None Jul 29 05:14:05.151227 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Domain-Name: None Jul 29 05:14:05.151227 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Identity-Status: Confirmed Jul 29 05:14:05.151227 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Is-Admin-Project: True Jul 29 05:14:05.151227 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 05:14:05.151227 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Project-Domain-Id: default Jul 29 05:14:05.151227 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Project-Domain-Name: Default Jul 29 05:14:05.151227 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Project-Id: 3340905a228b4864923e8ce0f5cfd8a4 Jul 29 05:14:05.151227 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Project-Name: admin Jul 29 05:14:05.151227 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Role: admin,member,reader Jul 29 05:14:05.151227 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Roles: admin,member,reader Jul 29 05:14:05.153343 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3340905a228b4864923e8ce0f5cfd8a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3340905a228b4864923e8ce0f5cfd8a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3340905a228b4864923e8ce0f5cfd8a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3340905a228b4864923e8ce0f5cfd8a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:14:05.153343 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Tenant: admin Jul 29 05:14:05.153343 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Tenant-Id: 3340905a228b4864923e8ce0f5cfd8a4 Jul 29 05:14:05.153343 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Tenant-Name: admin Jul 29 05:14:05.153343 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-User: admin Jul 29 05:14:05.153343 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-User-Domain-Id: default Jul 29 05:14:05.153343 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-User-Domain-Name: Default Jul 29 05:14:05.153343 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-User-Id: a74b2847a9d0472682c985005f47d70f Jul 29 05:14:05.153343 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-User-Name: admin Jul 29 05:14:05.153343 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: method: > Jul 29 05:14:05.153343 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: exception: Flavor 42 could not be found. Jul 29 05:14:05.153343 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: action_args: {'id': '42'} Jul 29 05:14:05.153343 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:14:05.153343 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:14:05.154490 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 05:14:05.154490 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 05:14:05.154490 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 05:14:05.154490 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 05:14:05.154490 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 05:14:05.154490 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 05:14:05.154490 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 05:14:05.154490 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 05:14:05.154490 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 05:14:05.154490 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:14:05.154490 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 05:14:05.154490 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 05:14:05.154490 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 29 05:14:05.154490 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi Jul 29 05:14:05.154490 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:14:05.154490 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi Jul 29 05:14:05.154490 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:14:05.154490 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:14:05.154490 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:14:05.156204 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:14:05.156204 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:14:05.156204 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:14:05.156204 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:14:05.156204 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 05:14:05.156204 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:14:05.156204 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 29 05:14:05.156204 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi Jul 29 05:14:05.156204 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:14:05.156204 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi Jul 29 05:14:05.156204 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:14:05.156204 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:14:05.156204 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:14:05.156204 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:14:05.156204 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:14:05.156204 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 29 05:14:05.156204 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi Jul 29 05:14:05.156204 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-a9a8e1db-cc4f-42c4-9cef-6084a5f3a857 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:14:05.157614 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-a9a8e1db-cc4f-42c4-9cef-6084a5f3a857 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.441050 Jul 29 05:14:05.157614 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 20/39] 10.222.0.49 () {60 vars in 1190 bytes} [Fri Jul 29 05:14:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 442 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 29 05:14:05.162952 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-813b1be1-103f-41f7-9c12-cda9cb17313d admin admin] Calling method '>' {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:14:05.168296 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG dbcounter [-] [103218] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=2 {{(pid=103218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:14:05.188544 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.requestlog [None req-813b1be1-103f-41f7-9c12-cda9cb17313d admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029209 Jul 29 05:14:05.189107 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: [pid: 103218|app: 0|req: 20/40] 10.222.0.49 () {60 vars in 1210 bytes} [Fri Jul 29 05:14:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:14:05.200767 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-98725ac3-059c-43da-9364-5dfa049550bf admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:14:05.226932 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-98725ac3-059c-43da-9364-5dfa049550bf admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030457 Jul 29 05:14:05.227603 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 21/41] 10.222.0.49 () {60 vars in 1210 bytes} [Fri Jul 29 05:14:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:14:05.237106 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-2bc62e94-9e2c-4e8d-9f4b-258c9aeb0991 admin admin] Calling method '>' {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:14:05.243103 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.wsgi [None req-2bc62e94-9e2c-4e8d-9f4b-258c9aeb0991 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 29 05:14:05.246510 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-2bc62e94-9e2c-4e8d-9f4b-258c9aeb0991 admin admin] Request method failure captured: Jul 29 05:14:05.246510 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 29 05:14:05.246510 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: Accept: application/json Jul 29 05:14:05.246510 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: Accept-Encoding: gzip, deflate Jul 29 05:14:05.246510 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: Connection: keep-alive Jul 29 05:14:05.246510 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: Content-Length: 0 Jul 29 05:14:05.246510 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: Host: 10.222.0.49 Jul 29 05:14:05.246510 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: Openstack-Api-Version: compute 2.90 Jul 29 05:14:05.246510 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: Openstack-System-Scope: None Jul 29 05:14:05.246510 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: User-Agent: python-novaclient Jul 29 05:14:05.246510 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Auth-Token: gAAAAABi42ycVOUdL3WZ7SFbFt8FkFfqyhI3c8c0iLXls9i0jIdrzrH_cddg881JY3WbMtvBC9mn3CjceyFfuIvuFxJUQ-yheC_HtcOOYZ5ubxXB7oAyZFOmuGpH-j513p0KoENAARxYmL8YOcMTFOjD3q5Y3yTBna6a6Ja_xQGzwDGg854XYKM Jul 29 05:14:05.246510 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Domain-Id: None Jul 29 05:14:05.246510 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Domain-Name: None Jul 29 05:14:05.246510 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Identity-Status: Confirmed Jul 29 05:14:05.246510 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Is-Admin-Project: True Jul 29 05:14:05.246510 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 05:14:05.246510 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Project-Domain-Id: default Jul 29 05:14:05.246510 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Project-Domain-Name: Default Jul 29 05:14:05.246510 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Project-Id: 3340905a228b4864923e8ce0f5cfd8a4 Jul 29 05:14:05.246510 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Project-Name: admin Jul 29 05:14:05.246510 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Role: admin,member,reader Jul 29 05:14:05.246510 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Roles: admin,member,reader Jul 29 05:14:05.248146 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3340905a228b4864923e8ce0f5cfd8a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3340905a228b4864923e8ce0f5cfd8a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3340905a228b4864923e8ce0f5cfd8a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3340905a228b4864923e8ce0f5cfd8a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:14:05.248146 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Tenant: admin Jul 29 05:14:05.248146 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Tenant-Id: 3340905a228b4864923e8ce0f5cfd8a4 Jul 29 05:14:05.248146 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Tenant-Name: admin Jul 29 05:14:05.248146 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-User: admin Jul 29 05:14:05.248146 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-User-Domain-Id: default Jul 29 05:14:05.248146 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-User-Domain-Name: Default Jul 29 05:14:05.248146 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-User-Id: a74b2847a9d0472682c985005f47d70f Jul 29 05:14:05.248146 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-User-Name: admin Jul 29 05:14:05.248146 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: method: > Jul 29 05:14:05.248146 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: exception: Flavor 42 could not be found. Jul 29 05:14:05.248146 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: action_args: {'id': '42'} Jul 29 05:14:05.248146 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:14:05.248146 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:14:05.249126 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 05:14:05.249126 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 05:14:05.249126 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 05:14:05.249126 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 05:14:05.249126 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 05:14:05.249126 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 05:14:05.249126 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 05:14:05.249126 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 05:14:05.249126 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 05:14:05.249126 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:14:05.249126 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 05:14:05.249126 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 05:14:05.249126 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 29 05:14:05.249126 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi Jul 29 05:14:05.249126 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:14:05.249126 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi Jul 29 05:14:05.249126 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:14:05.249126 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:14:05.249126 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:14:05.250471 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:14:05.250471 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:14:05.250471 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:14:05.250471 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:14:05.250471 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 05:14:05.250471 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:14:05.250471 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 29 05:14:05.250471 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi Jul 29 05:14:05.250471 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:14:05.250471 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi Jul 29 05:14:05.250471 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:14:05.250471 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:14:05.250471 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:14:05.250471 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:14:05.250471 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:14:05.250471 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 29 05:14:05.250471 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi Jul 29 05:14:05.250471 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-2bc62e94-9e2c-4e8d-9f4b-258c9aeb0991 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103218) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:14:05.251846 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.requestlog [None req-2bc62e94-9e2c-4e8d-9f4b-258c9aeb0991 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014473 Jul 29 05:14:05.251846 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: [pid: 103218|app: 0|req: 21/42] 10.222.0.49 () {60 vars in 1190 bytes} [Fri Jul 29 05:14:05 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 29 05:14:06.253241 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-98725ac3-059c-43da-9364-5dfa049550bf admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:14:06.254258 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-98725ac3-059c-43da-9364-5dfa049550bf admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jul 29 05:14:06.254661 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 22/43] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Jul 29 05:14:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:14:06.793917 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-7bb799c8-aa13-4c23-8326-5daf379f3f32 admin admin] Calling method '>' {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:14:06.799261 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.wsgi [None req-7bb799c8-aa13-4c23-8326-5daf379f3f32 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 29 05:14:06.800779 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-7bb799c8-aa13-4c23-8326-5daf379f3f32 admin admin] Request method failure captured: Jul 29 05:14:06.800779 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 29 05:14:06.800779 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: Accept: application/json Jul 29 05:14:06.800779 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: Accept-Encoding: gzip, deflate Jul 29 05:14:06.800779 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: Connection: keep-alive Jul 29 05:14:06.800779 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: Content-Length: 0 Jul 29 05:14:06.800779 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: Host: 10.222.0.49 Jul 29 05:14:06.800779 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: Openstack-Api-Version: compute 2.90 Jul 29 05:14:06.800779 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: Openstack-System-Scope: None Jul 29 05:14:06.800779 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: User-Agent: python-novaclient Jul 29 05:14:06.800779 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Auth-Token: gAAAAABi42yeASX3N5gtPZlRtG4aLgs9RbewfW4WRHkbOKSWMlG3UoHOLZkKYk2q5xmu_0vaFEce-c9Ela-1PgddAE9NMgHlb1lQ6035EM1ABARUiBBPS-DpAUdhUL40MG3Jb3hMszq96nHfAveqMgR3xbEFgrZTiJq7ShPZaLY9qrGeJVLtAJg Jul 29 05:14:06.800779 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Domain-Id: None Jul 29 05:14:06.800779 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Domain-Name: None Jul 29 05:14:06.800779 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Identity-Status: Confirmed Jul 29 05:14:06.800779 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Is-Admin-Project: True Jul 29 05:14:06.800779 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 05:14:06.800779 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Project-Domain-Id: default Jul 29 05:14:06.800779 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Project-Domain-Name: Default Jul 29 05:14:06.800779 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Project-Id: 3340905a228b4864923e8ce0f5cfd8a4 Jul 29 05:14:06.800779 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Project-Name: admin Jul 29 05:14:06.800779 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Role: admin,member,reader Jul 29 05:14:06.800779 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Roles: admin,member,reader Jul 29 05:14:06.802314 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3340905a228b4864923e8ce0f5cfd8a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3340905a228b4864923e8ce0f5cfd8a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3340905a228b4864923e8ce0f5cfd8a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3340905a228b4864923e8ce0f5cfd8a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:14:06.802314 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Tenant: admin Jul 29 05:14:06.802314 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Tenant-Id: 3340905a228b4864923e8ce0f5cfd8a4 Jul 29 05:14:06.802314 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Tenant-Name: admin Jul 29 05:14:06.802314 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-User: admin Jul 29 05:14:06.802314 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-User-Domain-Id: default Jul 29 05:14:06.802314 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-User-Domain-Name: Default Jul 29 05:14:06.802314 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-User-Id: a74b2847a9d0472682c985005f47d70f Jul 29 05:14:06.802314 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-User-Name: admin Jul 29 05:14:06.802314 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: method: > Jul 29 05:14:06.802314 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: exception: Flavor 84 could not be found. Jul 29 05:14:06.802314 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: action_args: {'id': '84'} Jul 29 05:14:06.802314 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:14:06.802314 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:14:06.803297 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 05:14:06.803297 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 05:14:06.803297 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 05:14:06.803297 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 05:14:06.803297 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 05:14:06.803297 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 05:14:06.803297 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 05:14:06.803297 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 05:14:06.803297 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 05:14:06.803297 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:14:06.803297 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 05:14:06.803297 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 05:14:06.803297 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 29 05:14:06.803297 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi Jul 29 05:14:06.803297 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:14:06.803297 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi Jul 29 05:14:06.803297 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:14:06.803297 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:14:06.803297 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:14:06.804640 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:14:06.804640 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:14:06.804640 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:14:06.804640 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:14:06.804640 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 05:14:06.804640 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:14:06.804640 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 29 05:14:06.804640 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi Jul 29 05:14:06.804640 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:14:06.804640 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi Jul 29 05:14:06.804640 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:14:06.804640 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:14:06.804640 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:14:06.804640 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:14:06.804640 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:14:06.804640 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 29 05:14:06.804640 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi Jul 29 05:14:06.804640 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-7bb799c8-aa13-4c23-8326-5daf379f3f32 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103218) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:14:06.806001 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.requestlog [None req-7bb799c8-aa13-4c23-8326-5daf379f3f32 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.407054 Jul 29 05:14:06.806001 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: [pid: 103218|app: 0|req: 22/44] 10.222.0.49 () {60 vars in 1190 bytes} [Fri Jul 29 05:14:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 408 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 29 05:14:06.811790 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-aef17205-bc8f-4598-bd4f-13b5830da93a admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:14:06.826864 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-aef17205-bc8f-4598-bd4f-13b5830da93a admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018568 Jul 29 05:14:06.827439 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 23/45] 10.222.0.49 () {60 vars in 1210 bytes} [Fri Jul 29 05:14:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:14:06.836969 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-8991f275-9297-4916-819c-632c5f62d501 admin admin] Calling method '>' {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:14:06.854959 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.requestlog [None req-8991f275-9297-4916-819c-632c5f62d501 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021546 Jul 29 05:14:06.855536 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: [pid: 103218|app: 0|req: 23/46] 10.222.0.49 () {60 vars in 1210 bytes} [Fri Jul 29 05:14:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:14:06.864992 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-19d6a25c-59c7-44d3-bf3e-7517e2e1d067 admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:14:06.870437 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.wsgi [None req-19d6a25c-59c7-44d3-bf3e-7517e2e1d067 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 29 05:14:06.871992 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-19d6a25c-59c7-44d3-bf3e-7517e2e1d067 admin admin] Request method failure captured: Jul 29 05:14:06.871992 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 29 05:14:06.871992 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: Accept: application/json Jul 29 05:14:06.871992 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: Accept-Encoding: gzip, deflate Jul 29 05:14:06.871992 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: Connection: keep-alive Jul 29 05:14:06.871992 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: Content-Length: 0 Jul 29 05:14:06.871992 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: Host: 10.222.0.49 Jul 29 05:14:06.871992 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: Openstack-Api-Version: compute 2.90 Jul 29 05:14:06.871992 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: Openstack-System-Scope: None Jul 29 05:14:06.871992 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: User-Agent: python-novaclient Jul 29 05:14:06.871992 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Auth-Token: gAAAAABi42yeASX3N5gtPZlRtG4aLgs9RbewfW4WRHkbOKSWMlG3UoHOLZkKYk2q5xmu_0vaFEce-c9Ela-1PgddAE9NMgHlb1lQ6035EM1ABARUiBBPS-DpAUdhUL40MG3Jb3hMszq96nHfAveqMgR3xbEFgrZTiJq7ShPZaLY9qrGeJVLtAJg Jul 29 05:14:06.871992 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Domain-Id: None Jul 29 05:14:06.871992 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Domain-Name: None Jul 29 05:14:06.871992 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Identity-Status: Confirmed Jul 29 05:14:06.871992 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Is-Admin-Project: True Jul 29 05:14:06.871992 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 05:14:06.871992 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Project-Domain-Id: default Jul 29 05:14:06.871992 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Project-Domain-Name: Default Jul 29 05:14:06.871992 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Project-Id: 3340905a228b4864923e8ce0f5cfd8a4 Jul 29 05:14:06.871992 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Project-Name: admin Jul 29 05:14:06.871992 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Role: admin,member,reader Jul 29 05:14:06.871992 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Roles: admin,member,reader Jul 29 05:14:06.873542 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3340905a228b4864923e8ce0f5cfd8a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3340905a228b4864923e8ce0f5cfd8a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3340905a228b4864923e8ce0f5cfd8a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3340905a228b4864923e8ce0f5cfd8a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:14:06.873542 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Tenant: admin Jul 29 05:14:06.873542 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Tenant-Id: 3340905a228b4864923e8ce0f5cfd8a4 Jul 29 05:14:06.873542 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Tenant-Name: admin Jul 29 05:14:06.873542 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-User: admin Jul 29 05:14:06.873542 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-User-Domain-Id: default Jul 29 05:14:06.873542 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-User-Domain-Name: Default Jul 29 05:14:06.873542 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-User-Id: a74b2847a9d0472682c985005f47d70f Jul 29 05:14:06.873542 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-User-Name: admin Jul 29 05:14:06.873542 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: method: > Jul 29 05:14:06.873542 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: exception: Flavor 84 could not be found. Jul 29 05:14:06.873542 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: action_args: {'id': '84'} Jul 29 05:14:06.873542 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:14:06.873542 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:14:06.874531 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 05:14:06.874531 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 05:14:06.874531 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 05:14:06.874531 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 05:14:06.874531 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 05:14:06.874531 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 05:14:06.874531 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 05:14:06.874531 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 05:14:06.874531 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 05:14:06.874531 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:14:06.874531 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 05:14:06.874531 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 05:14:06.874531 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 29 05:14:06.874531 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi Jul 29 05:14:06.874531 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:14:06.874531 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi Jul 29 05:14:06.874531 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:14:06.874531 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:14:06.874531 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:14:06.876186 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:14:06.876186 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:14:06.876186 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:14:06.876186 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:14:06.876186 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 05:14:06.876186 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:14:06.876186 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 29 05:14:06.876186 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi Jul 29 05:14:06.876186 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:14:06.876186 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi Jul 29 05:14:06.876186 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:14:06.876186 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:14:06.876186 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:14:06.876186 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:14:06.876186 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:14:06.876186 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 29 05:14:06.876186 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi Jul 29 05:14:06.876186 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-19d6a25c-59c7-44d3-bf3e-7517e2e1d067 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:14:06.877479 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-19d6a25c-59c7-44d3-bf3e-7517e2e1d067 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011859 Jul 29 05:14:06.877479 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 24/47] 10.222.0.49 () {60 vars in 1190 bytes} [Fri Jul 29 05:14:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 29 05:14:07.888288 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-8991f275-9297-4916-819c-632c5f62d501 admin admin] Calling method '>' {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:14:07.889288 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.requestlog [None req-8991f275-9297-4916-819c-632c5f62d501 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jul 29 05:14:07.889887 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: [pid: 103218|app: 0|req: 24/48] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Jul 29 05:14:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:14:08.445548 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-186c731d-77ac-4c6f-aff1-b91832ec1c38 admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:14:08.452172 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.wsgi [None req-186c731d-77ac-4c6f-aff1-b91832ec1c38 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 29 05:14:08.453692 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-186c731d-77ac-4c6f-aff1-b91832ec1c38 admin admin] Request method failure captured: Jul 29 05:14:08.453692 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 29 05:14:08.453692 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: Accept: application/json Jul 29 05:14:08.453692 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: Accept-Encoding: gzip, deflate Jul 29 05:14:08.453692 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: Connection: keep-alive Jul 29 05:14:08.453692 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: Content-Length: 0 Jul 29 05:14:08.453692 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: Host: 10.222.0.49 Jul 29 05:14:08.453692 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: Openstack-Api-Version: compute 2.90 Jul 29 05:14:08.453692 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: Openstack-System-Scope: None Jul 29 05:14:08.453692 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: User-Agent: python-novaclient Jul 29 05:14:08.453692 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Auth-Token: gAAAAABi42yf45imBawyHD6rD9nsO68ygmJ_bLhbWgU9rP5UZ7KRAG-87kRqWboOwn1qmcw1Ls1z6D3OzgDdVvB0GjPlVDKR33qk_DYmtUp8EVCBnNspAl66dddXS856Bn_ppxS2c6F4a2op7T5HJAWgFnVskP8-YffCgZ4G6S4lWs2jvDJ6TkI Jul 29 05:14:08.453692 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Domain-Id: None Jul 29 05:14:08.453692 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Domain-Name: None Jul 29 05:14:08.453692 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Identity-Status: Confirmed Jul 29 05:14:08.453692 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Is-Admin-Project: True Jul 29 05:14:08.453692 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 05:14:08.453692 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Project-Domain-Id: default Jul 29 05:14:08.453692 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Project-Domain-Name: Default Jul 29 05:14:08.453692 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Project-Id: 3340905a228b4864923e8ce0f5cfd8a4 Jul 29 05:14:08.453692 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Project-Name: admin Jul 29 05:14:08.453692 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Role: admin,member,reader Jul 29 05:14:08.453692 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Roles: admin,member,reader Jul 29 05:14:08.455281 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3340905a228b4864923e8ce0f5cfd8a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3340905a228b4864923e8ce0f5cfd8a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3340905a228b4864923e8ce0f5cfd8a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3340905a228b4864923e8ce0f5cfd8a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:14:08.455281 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Tenant: admin Jul 29 05:14:08.455281 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Tenant-Id: 3340905a228b4864923e8ce0f5cfd8a4 Jul 29 05:14:08.455281 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-Tenant-Name: admin Jul 29 05:14:08.455281 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-User: admin Jul 29 05:14:08.455281 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-User-Domain-Id: default Jul 29 05:14:08.455281 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-User-Domain-Name: Default Jul 29 05:14:08.455281 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-User-Id: a74b2847a9d0472682c985005f47d70f Jul 29 05:14:08.455281 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: X-User-Name: admin Jul 29 05:14:08.455281 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: method: > Jul 29 05:14:08.455281 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: exception: Flavor 451 could not be found. Jul 29 05:14:08.455281 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: action_args: {'id': '451'} Jul 29 05:14:08.455281 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:14:08.455281 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:14:08.457434 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 05:14:08.457434 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 05:14:08.457434 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 05:14:08.457434 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 05:14:08.457434 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 05:14:08.457434 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 05:14:08.457434 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 05:14:08.457434 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 05:14:08.457434 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 05:14:08.457434 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:14:08.457434 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 05:14:08.457434 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 05:14:08.457434 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 29 05:14:08.457434 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi Jul 29 05:14:08.457434 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:14:08.457434 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi Jul 29 05:14:08.457434 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:14:08.457434 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:14:08.457434 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:14:08.458576 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:14:08.458576 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:14:08.458576 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:14:08.458576 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:14:08.458576 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 05:14:08.458576 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:14:08.458576 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 29 05:14:08.458576 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi Jul 29 05:14:08.458576 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:14:08.458576 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi Jul 29 05:14:08.458576 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:14:08.458576 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:14:08.458576 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:14:08.458576 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:14:08.458576 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:14:08.458576 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 29 05:14:08.458576 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi Jul 29 05:14:08.458576 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-186c731d-77ac-4c6f-aff1-b91832ec1c38 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:14:08.459662 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-186c731d-77ac-4c6f-aff1-b91832ec1c38 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.425110 Jul 29 05:14:08.459662 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 25/49] 10.222.0.49 () {60 vars in 1193 bytes} [Fri Jul 29 05:14:08 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 426 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 29 05:14:08.465010 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-ee59b20c-1eb3-4fd5-b02a-3f0ec1f7d82c admin admin] Calling method '>' {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:14:08.480156 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.requestlog [None req-ee59b20c-1eb3-4fd5-b02a-3f0ec1f7d82c admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018858 Jul 29 05:14:08.480702 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: [pid: 103218|app: 0|req: 25/50] 10.222.0.49 () {60 vars in 1210 bytes} [Fri Jul 29 05:14:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:14:08.490304 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-d86b2157-4af4-4a22-b8e3-0b934b0e3d84 admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:14:08.505829 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-d86b2157-4af4-4a22-b8e3-0b934b0e3d84 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019091 Jul 29 05:14:08.506376 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 26/51] 10.222.0.49 () {60 vars in 1210 bytes} [Fri Jul 29 05:14:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:14:08.516726 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-4ddb339a-2abb-4da4-9d7b-fa7d61c17e94 admin admin] Calling method '>' {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:14:08.522132 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.wsgi [None req-4ddb339a-2abb-4da4-9d7b-fa7d61c17e94 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 29 05:14:08.523689 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-4ddb339a-2abb-4da4-9d7b-fa7d61c17e94 admin admin] Request method failure captured: Jul 29 05:14:08.523689 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 29 05:14:08.523689 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: Accept: application/json Jul 29 05:14:08.523689 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: Accept-Encoding: gzip, deflate Jul 29 05:14:08.523689 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: Connection: keep-alive Jul 29 05:14:08.523689 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: Content-Length: 0 Jul 29 05:14:08.523689 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: Host: 10.222.0.49 Jul 29 05:14:08.523689 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: Openstack-Api-Version: compute 2.90 Jul 29 05:14:08.523689 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: Openstack-System-Scope: None Jul 29 05:14:08.523689 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: User-Agent: python-novaclient Jul 29 05:14:08.523689 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Auth-Token: gAAAAABi42yf45imBawyHD6rD9nsO68ygmJ_bLhbWgU9rP5UZ7KRAG-87kRqWboOwn1qmcw1Ls1z6D3OzgDdVvB0GjPlVDKR33qk_DYmtUp8EVCBnNspAl66dddXS856Bn_ppxS2c6F4a2op7T5HJAWgFnVskP8-YffCgZ4G6S4lWs2jvDJ6TkI Jul 29 05:14:08.523689 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Domain-Id: None Jul 29 05:14:08.523689 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Domain-Name: None Jul 29 05:14:08.523689 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Identity-Status: Confirmed Jul 29 05:14:08.523689 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Is-Admin-Project: True Jul 29 05:14:08.523689 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 05:14:08.523689 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Project-Domain-Id: default Jul 29 05:14:08.523689 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Project-Domain-Name: Default Jul 29 05:14:08.523689 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Project-Id: 3340905a228b4864923e8ce0f5cfd8a4 Jul 29 05:14:08.523689 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Project-Name: admin Jul 29 05:14:08.523689 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Role: admin,member,reader Jul 29 05:14:08.523689 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Roles: admin,member,reader Jul 29 05:14:08.525110 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3340905a228b4864923e8ce0f5cfd8a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3340905a228b4864923e8ce0f5cfd8a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3340905a228b4864923e8ce0f5cfd8a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3340905a228b4864923e8ce0f5cfd8a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:14:08.525110 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Tenant: admin Jul 29 05:14:08.525110 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Tenant-Id: 3340905a228b4864923e8ce0f5cfd8a4 Jul 29 05:14:08.525110 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-Tenant-Name: admin Jul 29 05:14:08.525110 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-User: admin Jul 29 05:14:08.525110 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-User-Domain-Id: default Jul 29 05:14:08.525110 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-User-Domain-Name: Default Jul 29 05:14:08.525110 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-User-Id: a74b2847a9d0472682c985005f47d70f Jul 29 05:14:08.525110 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: X-User-Name: admin Jul 29 05:14:08.525110 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: method: > Jul 29 05:14:08.525110 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: exception: Flavor 451 could not be found. Jul 29 05:14:08.525110 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: action_args: {'id': '451'} Jul 29 05:14:08.525110 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:14:08.525110 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:14:08.526153 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 05:14:08.526153 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 05:14:08.526153 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 05:14:08.526153 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 05:14:08.526153 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 05:14:08.526153 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 05:14:08.526153 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 05:14:08.526153 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 05:14:08.526153 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 05:14:08.526153 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:14:08.526153 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 05:14:08.526153 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 05:14:08.526153 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 29 05:14:08.526153 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi Jul 29 05:14:08.526153 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:14:08.526153 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi Jul 29 05:14:08.526153 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:14:08.526153 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:14:08.526153 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:14:08.527520 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:14:08.527520 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:14:08.527520 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:14:08.527520 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:14:08.527520 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 05:14:08.527520 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:14:08.527520 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 29 05:14:08.527520 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi Jul 29 05:14:08.527520 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:14:08.527520 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi Jul 29 05:14:08.527520 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:14:08.527520 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:14:08.527520 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:14:08.527520 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:14:08.527520 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:14:08.527520 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 29 05:14:08.527520 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: ERROR nova.api.openstack.wsgi Jul 29 05:14:08.527520 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-4ddb339a-2abb-4da4-9d7b-fa7d61c17e94 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103218) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:14:08.528765 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.requestlog [None req-4ddb339a-2abb-4da4-9d7b-fa7d61c17e94 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011982 Jul 29 05:14:08.528765 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: [pid: 103218|app: 0|req: 26/52] 10.222.0.49 () {60 vars in 1193 bytes} [Fri Jul 29 05:14:08 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 29 05:14:09.530604 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-d86b2157-4af4-4a22-b8e3-0b934b0e3d84 admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:14:09.531644 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-d86b2157-4af4-4a22-b8e3-0b934b0e3d84 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 29 05:14:09.532042 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 27/53] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Jul 29 05:14:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:14:10.122605 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-c22a7e9f-d5da-482b-8028-37741dca07f3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:14:10.153054 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.requestlog [None req-c22a7e9f-d5da-482b-8028-37741dca07f3 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.481348 Jul 29 05:14:10.153627 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: [pid: 103218|app: 0|req: 27/54] 10.222.0.49 () {64 vars in 1235 bytes} [Fri Jul 29 05:14:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 05:14:11.170998 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-d86b2157-4af4-4a22-b8e3-0b934b0e3d84 admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:14:11.172047 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-d86b2157-4af4-4a22-b8e3-0b934b0e3d84 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jul 29 05:14:11.172693 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 28/55] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Jul 29 05:14:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:14:11.793668 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-292f8300-2fc0-4c89-90bb-3fb6a0613d43 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:14:11.814815 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.requestlog [None req-292f8300-2fc0-4c89-90bb-3fb6a0613d43 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.497468 Jul 29 05:14:11.815387 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: [pid: 103218|app: 0|req: 28/56] 10.222.0.49 () {64 vars in 1235 bytes} [Fri Jul 29 05:14:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 05:14:12.961406 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-d86b2157-4af4-4a22-b8e3-0b934b0e3d84 admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:14:12.962762 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-d86b2157-4af4-4a22-b8e3-0b934b0e3d84 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Jul 29 05:14:12.963306 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 29/57] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Jul 29 05:14:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:14:13.562520 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-60388795-2fae-407b-95bf-b0d7b778b682 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:14:13.587859 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.requestlog [None req-60388795-2fae-407b-95bf-b0d7b778b682 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.485625 Jul 29 05:14:13.588384 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: [pid: 103218|app: 0|req: 29/58] 10.222.0.49 () {64 vars in 1235 bytes} [Fri Jul 29 05:14:13 2022] POST /compute/v2.1/flavors => generated 407 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 05:14:14.593193 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-d86b2157-4af4-4a22-b8e3-0b934b0e3d84 admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:14:14.594208 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-d86b2157-4af4-4a22-b8e3-0b934b0e3d84 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Jul 29 05:14:14.594607 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 30/59] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Jul 29 05:14:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:14:15.142447 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-3c136686-1896-4ef0-9f4a-c5ff9b1858cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:14:15.163898 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.requestlog [None req-3c136686-1896-4ef0-9f4a-c5ff9b1858cf admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.432099 Jul 29 05:14:15.164448 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: [pid: 103218|app: 0|req: 30/60] 10.222.0.49 () {64 vars in 1235 bytes} [Fri Jul 29 05:14:14 2022] POST /compute/v2.1/flavors => generated 409 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 05:14:16.179981 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-d86b2157-4af4-4a22-b8e3-0b934b0e3d84 admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:14:16.181647 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-d86b2157-4af4-4a22-b8e3-0b934b0e3d84 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jul 29 05:14:16.182057 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 31/61] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Jul 29 05:14:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:14:16.757134 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-7db9e888-ab8d-45be-9ea1-cb089f92f8c2 admin admin] Calling method '>' {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:14:16.778469 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.requestlog [None req-7db9e888-ab8d-45be-9ea1-cb089f92f8c2 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.453996 Jul 29 05:14:16.779016 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: [pid: 103218|app: 0|req: 31/62] 10.222.0.49 () {60 vars in 1202 bytes} [Fri Jul 29 05:14:16 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:15:11.599035 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-d86b2157-4af4-4a22-b8e3-0b934b0e3d84 admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:15:11.600077 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-d86b2157-4af4-4a22-b8e3-0b934b0e3d84 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jul 29 05:15:11.600509 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 32/63] 10.222.0.49 () {54 vars in 930 bytes} [Fri Jul 29 05:15:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:15:11.612255 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG dbcounter [-] [103218] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:15:12.070608 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-993e05c4-2023-4362-a0a2-28942c23ed0e admin admin] Calling method '>' {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:15:12.091674 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.requestlog [None req-993e05c4-2023-4362-a0a2-28942c23ed0e admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.484772 Jul 29 05:15:12.092265 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: [pid: 103218|app: 0|req: 32/64] 10.222.0.49 () {60 vars in 1291 bytes} [Fri Jul 29 05:15:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:15:12.114501 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG dbcounter [-] [103219] Writing DB stats nova_api:SELECT=14 {{(pid=103219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:15:12.118895 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-2ab9abee-6b58-4e95-9649-072522eee5f2 admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:15:12.126918 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-2ab9abee-6b58-4e95-9649-072522eee5f2 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013848 Jul 29 05:15:12.127496 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 33/65] 10.222.0.49 () {60 vars in 1282 bytes} [Fri Jul 29 05:15:12 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:15:12.139562 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-59d68cce-8d4f-42a3-97c1-27b772c4503d admin admin] Calling method '>' {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:15:12.147286 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.requestlog [None req-59d68cce-8d4f-42a3-97c1-27b772c4503d admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011408 Jul 29 05:15:12.147852 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: [pid: 103218|app: 0|req: 33/66] 10.222.0.49 () {60 vars in 1285 bytes} [Fri Jul 29 05:15:12 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:15:12.167216 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-a89fc16a-39cf-4aba-8837-ca3b26b6de2f admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:15:12.177846 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-a89fc16a-39cf-4aba-8837-ca3b26b6de2f admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014589 Jul 29 05:15:12.178403 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 34/67] 10.222.0.49 () {60 vars in 1285 bytes} [Fri Jul 29 05:15:12 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:15:12.190256 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-fa49b47c-e1b5-4f32-9543-668656074e33 admin admin] Calling method '>' {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:15:12.198315 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.requestlog [None req-fa49b47c-e1b5-4f32-9543-668656074e33 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011699 Jul 29 05:15:12.198860 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: [pid: 103218|app: 0|req: 34/68] 10.222.0.49 () {60 vars in 1282 bytes} [Fri Jul 29 05:15:12 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:19:00.858991 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-a89fc16a-39cf-4aba-8837-ca3b26b6de2f admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:19:00.859983 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-a89fc16a-39cf-4aba-8837-ca3b26b6de2f admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jul 29 05:19:00.860377 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 35/69] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Jul 29 05:19:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:19:01.000525 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG dbcounter [-] [103218] Writing DB stats nova_api:SELECT=6 {{(pid=103218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:19:01.158012 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-8e00ff74-f27a-4de9-b7f2-358a8a2a5ac2 admin admin] Calling method '>' {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:19:01.160401 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 05:19:01.160401 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: warnings.warn(msg) Jul 29 05:19:01.161650 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG oslo_concurrency.lockutils [None req-8e00ff74-f27a-4de9-b7f2-358a8a2a5ac2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:19:01.162118 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG oslo_concurrency.lockutils [None req-8e00ff74-f27a-4de9-b7f2-358a8a2a5ac2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:19:01.162939 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG oslo_concurrency.lockutils [None req-8e00ff74-f27a-4de9-b7f2-358a8a2a5ac2 admin admin] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:19:01.163389 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG oslo_concurrency.lockutils [None req-8e00ff74-f27a-4de9-b7f2-358a8a2a5ac2 admin admin] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:19:01.198728 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.requestlog [None req-8e00ff74-f27a-4de9-b7f2-358a8a2a5ac2 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.199589 Jul 29 05:19:01.199301 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: [pid: 103218|app: 0|req: 35/70] 10.222.0.49 () {60 vars in 1193 bytes} [Fri Jul 29 05:19:00 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 05:19:02.036197 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-a89fc16a-39cf-4aba-8837-ca3b26b6de2f admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:19:02.037969 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-a89fc16a-39cf-4aba-8837-ca3b26b6de2f admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002146 Jul 29 05:19:02.038406 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 36/71] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Jul 29 05:19:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:19:02.235240 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-727d956c-58a4-447e-9f64-bfede6daa0e3 admin admin] Calling method '>' {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:19:02.237629 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 05:19:02.237629 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: warnings.warn(msg) Jul 29 05:19:02.238815 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG oslo_concurrency.lockutils [None req-727d956c-58a4-447e-9f64-bfede6daa0e3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:19:02.239253 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG oslo_concurrency.lockutils [None req-727d956c-58a4-447e-9f64-bfede6daa0e3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:19:02.240839 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG oslo_concurrency.lockutils [None req-727d956c-58a4-447e-9f64-bfede6daa0e3 admin admin] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:19:02.241278 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG oslo_concurrency.lockutils [None req-727d956c-58a4-447e-9f64-bfede6daa0e3 admin admin] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:19:02.260211 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.requestlog [None req-727d956c-58a4-447e-9f64-bfede6daa0e3 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076838 Jul 29 05:19:02.260749 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: [pid: 103218|app: 0|req: 36/72] 10.222.0.49 () {60 vars in 1193 bytes} [Fri Jul 29 05:19:02 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 05:19:13.507341 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-a89fc16a-39cf-4aba-8837-ca3b26b6de2f admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:19:13.508875 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-a89fc16a-39cf-4aba-8837-ca3b26b6de2f admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001977 Jul 29 05:19:13.509272 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 37/73] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Jul 29 05:19:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:19:13.670046 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG dbcounter [-] [103218] Writing DB stats nova_cell0:SELECT=4 {{(pid=103218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:19:13.670828 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG dbcounter [-] [103218] Writing DB stats nova_cell1:SELECT=4 {{(pid=103218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:19:13.671452 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG dbcounter [-] [103218] Writing DB stats nova_api:SELECT=8 {{(pid=103218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:19:13.733815 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-b887b596-312d-40b3-be18-977cd29db0f3 admin admin] Calling method '>' {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:19:13.736324 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 05:19:13.736324 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: warnings.warn(msg) Jul 29 05:19:13.737555 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG oslo_concurrency.lockutils [None req-b887b596-312d-40b3-be18-977cd29db0f3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:19:13.738002 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG oslo_concurrency.lockutils [None req-b887b596-312d-40b3-be18-977cd29db0f3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:19:13.738815 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG oslo_concurrency.lockutils [None req-b887b596-312d-40b3-be18-977cd29db0f3 admin admin] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:19:13.739249 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG oslo_concurrency.lockutils [None req-b887b596-312d-40b3-be18-977cd29db0f3 admin admin] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:19:13.768607 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.requestlog [None req-b887b596-312d-40b3-be18-977cd29db0f3 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.103216 Jul 29 05:19:13.769186 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: [pid: 103218|app: 0|req: 37/74] 10.222.0.49 () {60 vars in 1193 bytes} [Fri Jul 29 05:19:13 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:19:14.687580 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-a89fc16a-39cf-4aba-8837-ca3b26b6de2f admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:19:14.688594 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-a89fc16a-39cf-4aba-8837-ca3b26b6de2f admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jul 29 05:19:14.688992 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 38/75] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Jul 29 05:19:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:19:14.894844 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG nova.api.openstack.wsgi [None req-e336d788-f1c4-4139-b91d-7d0d8c73fc72 admin admin] Calling method '>' {{(pid=103218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:19:14.897173 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 05:19:14.897173 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: warnings.warn(msg) Jul 29 05:19:14.898951 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG oslo_concurrency.lockutils [None req-e336d788-f1c4-4139-b91d-7d0d8c73fc72 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:19:14.899635 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG oslo_concurrency.lockutils [None req-e336d788-f1c4-4139-b91d-7d0d8c73fc72 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:19:14.900436 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG oslo_concurrency.lockutils [None req-e336d788-f1c4-4139-b91d-7d0d8c73fc72 admin admin] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:19:14.900892 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: DEBUG oslo_concurrency.lockutils [None req-e336d788-f1c4-4139-b91d-7d0d8c73fc72 admin admin] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:19:14.928739 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: INFO nova.api.openstack.requestlog [None req-e336d788-f1c4-4139-b91d-7d0d8c73fc72 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.088470 Jul 29 05:19:14.930026 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: [pid: 103218|app: 0|req: 38/76] 10.222.0.49 () {60 vars in 1193 bytes} [Fri Jul 29 05:19:14 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:20:11.598149 dv-cinder-851279-2-iscsi devstack@n-api.service[103217]: Fri Jul 29 05:20:11 2022 - graceful shutdown triggered... Jul 29 05:20:11.598278 dv-cinder-851279-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 29 05:20:11.599413 dv-cinder-851279-2-iscsi devstack@n-api.service[103218]: Gracefully killing worker 1 (pid: 103218)... Jul 29 05:20:11.599845 dv-cinder-851279-2-iscsi devstack@n-api.service[103219]: Gracefully killing worker 2 (pid: 103219)... Jul 29 05:20:12.600594 dv-cinder-851279-2-iscsi devstack@n-api.service[103217]: worker 1 buried after 1 seconds Jul 29 05:20:12.600594 dv-cinder-851279-2-iscsi devstack@n-api.service[103217]: worker 2 buried after 1 seconds Jul 29 05:20:12.600594 dv-cinder-851279-2-iscsi devstack@n-api.service[103217]: goodbye to uWSGI. Jul 29 05:20:12.602606 dv-cinder-851279-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 29 05:20:12.603174 dv-cinder-851279-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 29 05:20:12.606005 dv-cinder-851279-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 29 05:20:12.615223 dv-cinder-851279-2-iscsi devstack@n-api.service[117799]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 29 05:20:12.618549 dv-cinder-851279-2-iscsi devstack@n-api.service[117799]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 29 05:20:12 2022] *** Jul 29 05:20:12.618549 dv-cinder-851279-2-iscsi devstack@n-api.service[117799]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 29 05:20:12.618549 dv-cinder-851279-2-iscsi devstack@n-api.service[117799]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 29 05:20:12.618549 dv-cinder-851279-2-iscsi devstack@n-api.service[117799]: nodename: dv-cinder-851279-2-iscsi Jul 29 05:20:12.618549 dv-cinder-851279-2-iscsi devstack@n-api.service[117799]: machine: x86_64 Jul 29 05:20:12.618549 dv-cinder-851279-2-iscsi devstack@n-api.service[117799]: clock source: unix Jul 29 05:20:12.618549 dv-cinder-851279-2-iscsi devstack@n-api.service[117799]: pcre jit disabled Jul 29 05:20:12.618549 dv-cinder-851279-2-iscsi devstack@n-api.service[117799]: detected number of CPU cores: 4 Jul 29 05:20:12.618549 dv-cinder-851279-2-iscsi devstack@n-api.service[117799]: current working directory: / Jul 29 05:20:12.618549 dv-cinder-851279-2-iscsi devstack@n-api.service[117799]: detected binary path: /usr/bin/uwsgi-core Jul 29 05:20:12.618549 dv-cinder-851279-2-iscsi devstack@n-api.service[117799]: your processes number limit is 47680 Jul 29 05:20:12.618549 dv-cinder-851279-2-iscsi devstack@n-api.service[117799]: your memory page size is 4096 bytes Jul 29 05:20:12.618549 dv-cinder-851279-2-iscsi devstack@n-api.service[117799]: detected max file descriptor number: 2048 Jul 29 05:20:12.618549 dv-cinder-851279-2-iscsi devstack@n-api.service[117799]: lock engine: pthread robust mutexes Jul 29 05:20:12.619726 dv-cinder-851279-2-iscsi devstack@n-api.service[117799]: thunder lock: enabled Jul 29 05:20:12.619726 dv-cinder-851279-2-iscsi devstack@n-api.service[117799]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 29 05:20:12.619726 dv-cinder-851279-2-iscsi devstack@n-api.service[117799]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 29 05:20:12.658499 dv-cinder-851279-2-iscsi devstack@n-api.service[117799]: Python main interpreter initialized at 0x562758b249c0 Jul 29 05:20:12.658499 dv-cinder-851279-2-iscsi devstack@n-api.service[117799]: python threads support enabled Jul 29 05:20:12.658499 dv-cinder-851279-2-iscsi devstack@n-api.service[117799]: your server socket listen backlog is limited to 100 connections Jul 29 05:20:12.658499 dv-cinder-851279-2-iscsi devstack@n-api.service[117799]: your mercy for graceful operations on workers is 90 seconds Jul 29 05:20:12.658949 dv-cinder-851279-2-iscsi devstack@n-api.service[117799]: mapped 403077 bytes (393 KB) for 2 cores Jul 29 05:20:12.658949 dv-cinder-851279-2-iscsi devstack@n-api.service[117799]: *** Operational MODE: preforking *** Jul 29 05:20:12.659211 dv-cinder-851279-2-iscsi devstack@n-api.service[117799]: *** uWSGI is running in multiple interpreter mode *** Jul 29 05:20:12.659211 dv-cinder-851279-2-iscsi devstack@n-api.service[117799]: spawned uWSGI master process (pid: 117799) Jul 29 05:20:12.659640 dv-cinder-851279-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 29 05:20:12.661610 dv-cinder-851279-2-iscsi devstack@n-api.service[117799]: spawned uWSGI worker 1 (pid: 117820, cores: 1) Jul 29 05:20:12.661610 dv-cinder-851279-2-iscsi devstack@n-api.service[117799]: spawned uWSGI worker 2 (pid: 117821, cores: 1) Jul 29 05:20:12.661610 dv-cinder-851279-2-iscsi devstack@n-api.service[117799]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 29 05:20:13.334671 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 29 05:20:13.344616 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 29 05:20:14.502878 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 05:20:14.502878 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: from cryptography.utils import int_from_bytes Jul 29 05:20:14.504064 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 05:20:14.504064 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: from cryptography.utils import int_from_bytes Jul 29 05:20:14.504310 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 05:20:14.504310 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: from cryptography.utils import int_from_bytes Jul 29 05:20:14.504310 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 05:20:14.504310 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: from cryptography.utils import int_from_bytes Jul 29 05:20:16.949903 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 29 05:20:16.950561 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 29 05:20:16.950561 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 29 05:20:16.950988 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 29 05:20:16.950988 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 29 05:20:16.951140 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 29 05:20:16.951223 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 29 05:20:16.951311 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 29 05:20:16.951764 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 29 05:20:16.951866 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 29 05:20:16.951948 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.952026 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.952115 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.952194 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.952265 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.952341 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.952576 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.952686 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.952852 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.953011 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.953112 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.953295 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.953404 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.953625 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.953736 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.953952 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.954054 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.954273 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.954374 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.954550 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.954655 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.954855 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.955025 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851279-2-iscsi {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.955182 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851279-2-iscsi {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.955342 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.955575 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.955782 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.955940 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.956086 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.956242 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.956405 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.956571 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.956747 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.956909 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.957063 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.957208 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.957392 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.957546 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.958959 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.959229 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.959489 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.959739 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.959974 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.959974 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.960404 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.960404 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.960833 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.960833 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.961495 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.961831 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.962055 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.962479 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.962706 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.962938 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.963162 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.963418 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.963649 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.963873 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.964104 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.964104 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.964558 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851279-2-iscsi {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.964558 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.964954 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851279-2-iscsi {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.964954 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.965290 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.965580 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.965580 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.966437 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.966600 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.966757 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.966918 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.967071 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.967466 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.967655 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.967817 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.968196 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.968196 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.968488 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.968642 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.968800 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.968955 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.969108 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.969264 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.969411 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.969556 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.969714 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.969867 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.970011 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.970163 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.970375 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.970535 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.970703 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.970866 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.971022 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.971168 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.971324 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.971663 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.971846 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.972006 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.972159 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.972313 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.972467 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.972624 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.972775 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.972943 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.973108 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.973262 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.973415 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.973579 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.973737 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.973892 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.974047 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.974193 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.974353 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.974507 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.974673 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.974827 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.974982 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.975136 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.975291 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.975480 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.975789 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.975974 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.976508 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.976689 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.976689 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.978627 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.978809 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.978958 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.979104 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.979263 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.979485 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.979648 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.979802 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.979956 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.980102 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.980262 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.980408 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.980560 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.980705 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.980873 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.981020 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.981249 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.981405 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.981560 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.981707 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.981860 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.982034 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.982182 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.982336 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.982491 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.982636 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.982802 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.982958 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.983224 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.983424 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.983578 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.983735 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.983893 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.984061 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.984216 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.984362 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.984514 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.984665 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.984823 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.984823 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.985123 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.985280 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.985433 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.985433 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.985911 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.986082 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.986674 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.986832 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.986986 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.987154 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.987316 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.987751 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.987929 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.988077 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.988233 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.988885 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.989049 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.989203 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.989358 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.989515 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.989669 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.990283 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.990472 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.990622 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.990877 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.991054 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.991210 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.991386 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.991558 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.991713 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.991867 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.992020 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.992173 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.992354 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.993086 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.993835 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.994100 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.994266 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.994439 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.994600 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.994803 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.994957 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.995108 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.995262 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.995441 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.995604 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.995810 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.996081 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.996246 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.996825 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.997001 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.997156 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.997312 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.997459 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.997459 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.997969 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.998116 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.998272 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.998426 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.998583 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.998982 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.999136 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.999292 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:16.999507 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.000258 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.000425 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.000581 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.000727 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.000888 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.001042 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.001196 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.001196 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.001484 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.001630 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.001790 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.001790 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.002088 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.002242 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.002396 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.002542 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.002542 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.002842 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.002997 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.002997 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.003279 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.003450 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.003610 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.003765 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.003928 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.004089 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.004396 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.004559 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.004716 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.004864 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.004864 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.005149 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.005302 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.005457 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.005610 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.005756 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.005959 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.006213 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.006367 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.006765 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.007018 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.007184 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.007340 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.007521 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 05:20:17.007675 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.008062 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.008830 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.009202 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.009360 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.009506 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.009681 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.009828 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.009974 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.010129 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.010277 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.010429 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.010588 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.010772 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.010934 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.011096 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.011250 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.011454 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.011637 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.011784 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.011930 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.012087 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.012233 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.012394 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.012542 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.012693 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.012846 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.012996 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.013145 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.013305 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.013466 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.013705 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.013861 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.014014 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.014171 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.014325 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.014486 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.014632 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.014784 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.014943 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.014943 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.015234 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.015441 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.015604 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.015767 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.015964 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.016120 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.016361 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.016523 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.016689 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.017170 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.017326 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.017473 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.017627 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.017788 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.018111 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.018277 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.018434 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.018581 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.018743 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.018896 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.019066 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.019486 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.019641 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.019789 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.019944 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.020098 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.020251 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.020397 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.020608 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.020763 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.020925 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.021087 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.021261 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.021412 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.021558 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.021712 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.021874 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.022046 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.022196 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.022342 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.022487 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.022655 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.022810 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.022957 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.023109 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.023263 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.023442 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.023650 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.023820 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.024764 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.024930 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.025079 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.025226 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.025381 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.025549 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.025696 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.025853 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.026087 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.026245 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.026521 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.026683 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.026850 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.027372 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.027557 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.027724 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.027886 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.028055 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.028440 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.028440 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.028780 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.028941 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.029095 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.029273 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.029665 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.029819 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.029966 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.030122 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.030270 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.030415 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.030580 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.030726 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.030880 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.031035 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.031035 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.031321 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.031548 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.031696 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.031849 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.032004 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.032161 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.032317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.032470 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.032627 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.032782 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.032929 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.033084 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.033239 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.033397 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.033544 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.033700 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.033847 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.034005 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.034157 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.034303 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.034449 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.034619 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.034766 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.034912 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.035057 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.035202 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.035365 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.035531 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.035689 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.035836 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.035980 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.036176 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.036344 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.036528 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.036776 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.036935 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.037101 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.037602 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.037767 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.037915 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.038069 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.038231 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.038553 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.038704 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.038864 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.039020 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.039020 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.042103 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.042257 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.042413 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.042572 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.042719 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.042872 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.043019 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.043173 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.044612 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.044779 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.044932 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.045080 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.045253 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.045410 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.045569 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.045716 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.045877 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.046037 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.046183 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.046398 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.046556 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.046702 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.046965 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.047120 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.047281 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.047860 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.048030 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.048187 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.048341 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.048524 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.048837 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.049020 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.049277 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.049483 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.049661 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.049810 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.049956 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.050152 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.050315 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.050481 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.050741 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.050930 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.051079 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.051310 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.051485 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.051634 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.051868 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.052050 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.052209 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.052487 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.052667 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.052829 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.052988 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.053141 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.053310 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.053463 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.053614 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.053774 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.053927 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.054078 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.054239 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.054400 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.054553 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.054715 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.055655 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.057060 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.057261 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.057445 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.057645 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.058193 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.058357 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.058513 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.058678 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.059071 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.059250 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.059250 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.059633 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.059788 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.059951 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.060104 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.060255 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.060407 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.060568 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.060751 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.061034 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.061192 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.061353 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.061505 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.061666 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.061845 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.062005 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.062159 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.062317 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.062498 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.062498 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.062937 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.063100 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.063100 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.063425 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.063596 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.063758 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.063920 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.063920 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.064238 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.064397 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.064397 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.064699 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.064859 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.064859 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.065165 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.065318 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.065318 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.065629 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.066410 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.066630 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.066805 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.066805 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.067131 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.067621 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.067804 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.068344 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.068516 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.068671 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.068833 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.069191 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.069365 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.069530 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.069692 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.069845 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.069997 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.070150 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.070311 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.070546 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.070992 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.071938 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.072111 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.072275 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.072436 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.072612 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.072787 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.073074 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.073245 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.073407 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.073569 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.073722 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.073881 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.074034 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.074193 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.074347 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.074508 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.075288 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.075574 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.075897 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.076075 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.076238 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.076408 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.076629 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.076789 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.076952 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.077105 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.077266 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.077491 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.077651 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.077804 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.077969 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.078557 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.078721 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.079332 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.079533 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.079690 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.079843 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.079995 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.079995 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.079995 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.079995 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.080769 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.080938 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.081105 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.081213 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.081213 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.081460 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.081562 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.081656 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.081750 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.081878 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.081972 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.082066 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.082162 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.082248 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.082342 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.082416 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.082496 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.082611 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.082695 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.082768 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.082768 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.082912 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.082983 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.083333 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.083481 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.083556 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.083636 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.083709 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.083779 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.083866 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.083991 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.084066 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.084149 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.084221 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.084291 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.084368 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.084448 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.084528 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.084601 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.084670 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.084740 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.084809 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.084878 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.084956 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.084956 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.085100 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.085100 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.085241 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.085311 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.085393 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.085478 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.085550 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.085635 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.085708 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.085787 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.085878 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.085955 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.086028 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.086151 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.086225 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.086315 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.086389 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.086532 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.087241 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.087432 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.087520 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.087594 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.087678 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.087760 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.087831 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.087908 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.087980 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.088057 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.088137 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.088232 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.088310 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.088820 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.088903 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.088984 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.089071 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.089162 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.089270 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.089555 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.089656 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.089737 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.089819 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.089909 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.090701 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.090813 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.090910 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.091013 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.091099 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.091183 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.091266 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.091387 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.091475 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.091579 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.091673 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.091673 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.091673 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.092019 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.092106 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.092268 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.092355 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.092438 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.092529 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.092621 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.092706 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.092802 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.092887 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.092977 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.093068 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.093160 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.093160 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.093598 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.093598 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.093799 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.093888 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.093979 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.094072 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.094164 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.094249 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.094340 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.094424 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.094514 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.094633 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.094789 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.094892 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.094985 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.095070 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.095163 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.095248 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.095338 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.095484 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.095579 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.095670 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.095670 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.095890 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.095986 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.096080 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.096165 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.096255 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.096349 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.096443 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.096535 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.096627 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.096718 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.096803 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.096908 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.096995 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.097085 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.097239 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.097340 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.097426 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.097519 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.097612 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.097697 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.097796 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.097909 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.098028 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.098115 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.098200 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.098283 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.098367 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.099327 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.099774 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.099869 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.099954 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.100039 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.100140 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.100245 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.100382 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.100474 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.100558 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.100649 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.100745 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.100819 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.100899 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.100971 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.101055 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.101137 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.101228 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.101335 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.101435 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.101542 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.101628 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.102281 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.102444 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.103053 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.103242 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.103436 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.103658 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.103927 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.104118 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.104286 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.105160 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.105344 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.105506 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.105709 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.105866 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.106032 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.106186 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.106347 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.106521 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.106681 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.106850 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.107015 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.107176 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.107410 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.107579 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.107741 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.107905 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.108058 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.108218 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.108371 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.108531 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.109116 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.109294 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.109468 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.109648 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.109979 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.110133 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.110294 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.110461 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.110614 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.110805 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.110966 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.111133 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.111294 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.111511 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.111665 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.111830 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.111984 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.112149 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.112311 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.112464 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.112633 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.112786 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.112937 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.113090 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.113255 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.113407 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.113579 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.113740 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.113922 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.114179 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.114347 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.114509 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.114669 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.114822 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.114973 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.115160 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.115433 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.115596 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.115756 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.115909 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.116072 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.116247 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.116400 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.116560 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.116720 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.116872 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.117023 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.117190 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.118063 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.118636 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.119246 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.119463 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.119631 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.119822 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.120128 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.120291 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.120445 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.120597 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.120749 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.120749 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.121053 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.121209 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.121361 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.121515 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.121676 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.121836 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.122010 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.122163 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.122321 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.122483 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.122719 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.122875 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.123074 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.123230 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.123401 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.123561 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.123725 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.123879 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.124038 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.124220 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.124463 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.124621 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.124783 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.124936 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.125095 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.125257 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.125440 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.125693 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.125862 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.126016 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.126175 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.126331 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.126501 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.126665 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.126824 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.126988 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.127182 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.127420 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.127596 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.127596 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.127596 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.127596 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.129511 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.129669 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.129846 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.130000 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.130316 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.130483 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.130637 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.130789 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.130953 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.131106 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.131258 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.131442 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.131602 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.131764 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.131929 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.132102 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.132255 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.132421 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.132573 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.132725 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.132886 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.133625 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.133811 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.133970 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.134124 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.134277 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.134465 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.134758 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.134944 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.135118 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.135295 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.135494 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.135678 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.135949 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.136108 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.136261 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.136424 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.136587 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.136740 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.136892 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.137051 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.137225 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.137378 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.137545 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.137698 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.137849 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.138007 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.138160 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.138312 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.138478 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.138644 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.138803 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.138962 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.139139 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.139545 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.139545 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.139849 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.140001 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.140153 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.140153 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.140620 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.140781 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.140934 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.141085 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.141238 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.141399 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.141578 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.141745 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.141905 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.142059 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.142220 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.142375 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.142534 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.142687 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.142838 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.142989 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.143155 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.143309 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.143501 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.143676 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.143830 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.143991 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.144154 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.144334 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.144625 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.144895 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.145062 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.145232 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.145385 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.145539 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.145693 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.145865 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.146130 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.146305 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.146467 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.146621 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.146781 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.146941 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.147101 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.147264 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.147452 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.147618 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.147794 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.147904 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.147999 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.148177 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.148278 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.148367 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.148455 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.148541 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.148681 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.148772 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.148939 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.149069 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.149145 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.149218 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.149308 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.149391 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.149497 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.149611 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.149720 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.149796 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.149891 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.149974 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.150054 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.150141 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.150234 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.150329 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.150425 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.150514 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.150595 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.150668 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.150740 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.150850 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.150939 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.151034 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.151122 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.151215 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.151309 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.151438 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.151537 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.151624 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.151710 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.151795 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.151879 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.152100 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.152197 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.152279 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.152362 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.152443 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.152523 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.152609 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.152683 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.152762 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.152841 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.152920 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.153002 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.153082 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.153155 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.153234 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.153309 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.153381 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.153469 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.153552 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.153626 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.153704 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.153786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.153866 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.153951 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.154031 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.154104 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.154182 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.154260 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.154347 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.154421 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.154492 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.154571 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.154653 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.154735 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.154816 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.154897 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.154970 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.155048 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.155122 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.155201 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.155282 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.155382 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.155462 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.155534 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.155618 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.155693 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.155774 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.155854 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.155934 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.156007 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.156079 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.156162 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.156235 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.156313 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.156394 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.156467 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.156545 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.156625 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.156706 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.156779 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.156850 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.156929 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.157007 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.157088 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.157167 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.157241 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.157313 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.157384 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.157456 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.157540 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.157619 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.157691 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.157826 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.157906 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.157992 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.158066 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.158146 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.158225 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.158305 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.158394 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.158477 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.158558 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.158631 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.158710 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.158782 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.158861 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.158946 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.159021 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.159092 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.159164 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.159234 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.159306 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.159306 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.159476 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.159558 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.159637 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.159710 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.159783 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.159864 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.159945 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.160020 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.160101 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.160174 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.160258 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.160332 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.160411 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.160491 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.160564 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.160642 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.160723 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.160797 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.160882 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.160954 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.161039 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.161115 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.161200 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.161281 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.161362 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.161435 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.161507 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.161590 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.161664 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.161735 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.161814 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.161887 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.161966 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.162048 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.162121 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.162193 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.162264 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.162342 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.162428 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.162502 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.162581 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.162661 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.162742 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.162817 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.162901 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.162975 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.163047 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.163118 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.163196 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.163378 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.163491 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.163574 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.163655 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.163730 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.163814 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.163901 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.163986 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.164067 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.164146 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.164792 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.164946 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.165083 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.165224 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.165320 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.165395 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.165476 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.165818 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.165903 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.165977 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.166049 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.166120 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.166198 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.166284 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.166358 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.166437 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.166516 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.166595 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.166674 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.166759 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.166839 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.166911 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.166988 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.167080 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.167159 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.167240 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.167313 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.167418 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.167502 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.167583 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.167669 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.167669 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.167868 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.167957 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.168039 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.168113 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.168199 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.168286 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.168360 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.168431 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.168501 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.168579 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.168665 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.168739 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.168810 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.168881 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.168959 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.169039 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.169121 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.169193 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.169264 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.169342 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.169422 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.169503 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.169586 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.169678 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.169753 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.169753 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.169900 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.169900 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.170048 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.170126 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.170198 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.170270 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.170341 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.170424 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.170498 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.170584 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.170658 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.170735 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.170820 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.170894 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.170973 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.171049 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.171128 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.171201 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.171284 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.171407 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.171558 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.171663 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.171742 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.171823 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.171909 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.171984 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.172055 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.172126 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.172196 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.172274 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.172355 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.172435 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.172435 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.172566 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.172644 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.172724 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.172797 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.172876 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.172949 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.173026 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.173100 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.173184 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.173266 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.173339 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.173418 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.173418 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.173418 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.173418 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.173418 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.173418 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.173418 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.173418 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.173904 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.173904 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.173904 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.173904 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.173904 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.173904 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.173904 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.173904 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.174587 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.174587 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.174587 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.174819 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.174919 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.175006 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.175006 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.175176 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.175261 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.175261 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.175453 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.175576 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.175888 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.175985 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.176296 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.176726 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.176950 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.177048 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.177469 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.177572 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.177815 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.178137 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.178283 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.178466 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.178773 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.178867 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.179183 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.179406 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.179535 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.179864 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.180651 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.180761 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.181177 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.181277 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.181669 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.181795 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.182002 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.182333 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.182435 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.182702 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.182971 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.183065 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.183584 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.183708 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.183991 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.184177 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.184327 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.184681 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.184786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.185025 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.185315 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.185552 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.185658 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.185817 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.185954 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.186150 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.186327 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.186634 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.186753 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.186925 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.187081 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.187498 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.187630 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.187728 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.187816 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.187908 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.188046 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.188211 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.188365 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.188536 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.188681 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.188893 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.189000 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.189177 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.189340 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.189499 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.189650 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.189822 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.189971 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.190142 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.190292 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.190462 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.190594 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.190782 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.190914 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.191105 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.191231 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.191482 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.191600 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.191821 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.191961 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.192150 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.192248 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.192475 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.192578 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.192795 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.192902 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.193105 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.193201 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.193450 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.193561 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.193736 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.193842 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.194054 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.194149 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.194380 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.194474 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.194721 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.194819 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.195041 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.195451 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.195645 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.195801 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.196096 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.196237 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.196550 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.196689 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.196877 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.197010 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.197207 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.197332 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.197540 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.197685 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.197860 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.197994 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.198192 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.198336 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.198499 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.198620 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.198807 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.199118 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.200606 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.201270 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.201377 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.201488 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.201577 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.201662 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.201752 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.201827 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.201898 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.201898 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.202044 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.202122 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.202200 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.202278 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.202349 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.202437 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.202524 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.202608 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.202690 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.202781 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.202874 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.202974 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.203060 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.203143 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.203267 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.203384 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.203598 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.203695 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.203905 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.204002 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.204220 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.204368 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.204524 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.204634 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.204839 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.204945 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.205142 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.205245 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.205457 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.205559 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.205753 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.205856 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.206071 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.206172 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.206389 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.206798 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.206798 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.206982 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.206982 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.207152 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.207413 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.207639 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.207639 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.207964 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.208067 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.208164 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.208252 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.208345 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.208553 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.208651 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.208865 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.208968 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.209172 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.209318 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.209484 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.209612 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.209800 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.209949 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.210113 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.210250 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.210426 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.210572 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.210720 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.210861 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.211038 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.211224 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.211452 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.211590 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.211795 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.211926 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.212120 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.212249 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.212456 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.212604 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.212787 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.212924 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.213106 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.213243 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.213423 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.213566 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.213720 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.213852 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.214029 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.214165 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.214360 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.214505 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.214672 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.214818 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.214983 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.215128 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.215294 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.215466 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.215631 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.215771 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.215941 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.216078 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.216256 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.216478 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.216613 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.216745 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.216878 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.217010 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.217151 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.217292 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.217454 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.217599 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.217781 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.217926 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.218107 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.218251 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.218418 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.218562 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.218745 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.218881 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.219073 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.219202 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.219414 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.219565 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.219738 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.219888 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.220065 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.220202 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.220390 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.220526 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.220704 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.220847 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.221018 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.221154 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.221326 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.221463 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.221602 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 29 05:20:17.221750 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.221967 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.222305 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.222623 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.222961 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.223299 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.223697 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.224020 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.224377 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.224717 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.225040 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.225364 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.225679 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 05:20:17.225931 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 29 05:20:17.283131 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO dbcounter [None req-9b0f3747-f23c-4bf1-b0ee-9ad32c285cd7 None None] Registered counter for database nova_api Jul 29 05:20:17.287697 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO dbcounter [None req-85967a3e-e2a3-4cc4-a4dd-078c06b6ba78 None None] Registered counter for database nova_api Jul 29 05:20:17.304877 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_db.sqlalchemy.engines [None req-9b0f3747-f23c-4bf1-b0ee-9ad32c285cd7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117820) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 05:20:17.308852 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_db.sqlalchemy.engines [None req-85967a3e-e2a3-4cc4-a4dd-078c06b6ba78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117821) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 05:20:17.311971 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writer thread running {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 05:20:17.315684 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writer thread running {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 05:20:17.367924 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.context [None req-9b0f3747-f23c-4bf1-b0ee-9ad32c285cd7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2(cell1) {{(pid=117820) load_cells /opt/stack/nova/nova/context.py:464}} Jul 29 05:20:17.372940 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.context [None req-85967a3e-e2a3-4cc4-a4dd-078c06b6ba78 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2(cell1) {{(pid=117821) load_cells /opt/stack/nova/nova/context.py:464}} Jul 29 05:20:17.373155 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9b0f3747-f23c-4bf1-b0ee-9ad32c285cd7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:20:17.374650 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9b0f3747-f23c-4bf1-b0ee-9ad32c285cd7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:20:17.375473 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9b0f3747-f23c-4bf1-b0ee-9ad32c285cd7 None None] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:20:17.377131 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-85967a3e-e2a3-4cc4-a4dd-078c06b6ba78 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:20:17.377497 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9b0f3747-f23c-4bf1-b0ee-9ad32c285cd7 None None] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:20:17.378752 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-85967a3e-e2a3-4cc4-a4dd-078c06b6ba78 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:20:17.379523 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO dbcounter [None req-9b0f3747-f23c-4bf1-b0ee-9ad32c285cd7 None None] Registered counter for database nova_cell0 Jul 29 05:20:17.379637 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-85967a3e-e2a3-4cc4-a4dd-078c06b6ba78 None None] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:20:17.381634 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-85967a3e-e2a3-4cc4-a4dd-078c06b6ba78 None None] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:20:17.384263 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO dbcounter [None req-85967a3e-e2a3-4cc4-a4dd-078c06b6ba78 None None] Registered counter for database nova_cell0 Jul 29 05:20:17.384492 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO dbcounter [None req-9b0f3747-f23c-4bf1-b0ee-9ad32c285cd7 None None] Registered counter for database nova_cell1 Jul 29 05:20:17.388340 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO dbcounter [None req-85967a3e-e2a3-4cc4-a4dd-078c06b6ba78 None None] Registered counter for database nova_cell1 Jul 29 05:20:17.391692 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_db.sqlalchemy.engines [None req-9b0f3747-f23c-4bf1-b0ee-9ad32c285cd7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117820) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 05:20:17.393951 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_db.sqlalchemy.engines [None req-9b0f3747-f23c-4bf1-b0ee-9ad32c285cd7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117820) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 05:20:17.396609 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_db.sqlalchemy.engines [None req-85967a3e-e2a3-4cc4-a4dd-078c06b6ba78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117821) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 05:20:17.397424 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_db.sqlalchemy.engines [None req-85967a3e-e2a3-4cc4-a4dd-078c06b6ba78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117821) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 05:20:17.402339 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writer thread running {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 05:20:17.402669 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writer thread running {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 05:20:17.403905 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writer thread running {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 05:20:17.405991 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writer thread running {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 05:20:17.551007 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO dbcounter [None req-9b0f3747-f23c-4bf1-b0ee-9ad32c285cd7 None None] Registered counter for database nova_cell0 Jul 29 05:20:17.551328 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO dbcounter [None req-85967a3e-e2a3-4cc4-a4dd-078c06b6ba78 None None] Registered counter for database nova_cell0 Jul 29 05:20:17.559211 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_db.sqlalchemy.engines [None req-9b0f3747-f23c-4bf1-b0ee-9ad32c285cd7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117820) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 05:20:17.560718 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_db.sqlalchemy.engines [None req-85967a3e-e2a3-4cc4-a4dd-078c06b6ba78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117821) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 05:20:17.563963 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writer thread running {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 05:20:17.565502 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writer thread running {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 05:20:17.885908 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: WARNING keystonemiddleware.auth_token [None req-85967a3e-e2a3-4cc4-a4dd-078c06b6ba78 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 05:20:17.893639 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: WARNING keystonemiddleware.auth_token [None req-85967a3e-e2a3-4cc4-a4dd-078c06b6ba78 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 05:20:17.898449 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: WARNING keystonemiddleware.auth_token [None req-9b0f3747-f23c-4bf1-b0ee-9ad32c285cd7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 05:20:17.907122 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: WARNING keystonemiddleware.auth_token [None req-9b0f3747-f23c-4bf1-b0ee-9ad32c285cd7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 05:20:18.253908 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: WARNING keystonemiddleware.auth_token [None req-85967a3e-e2a3-4cc4-a4dd-078c06b6ba78 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 05:20:18.260650 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: WARNING keystonemiddleware.auth_token [None req-85967a3e-e2a3-4cc4-a4dd-078c06b6ba78 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 05:20:18.265981 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562758b249c0 pid: 117821 (default app) Jul 29 05:20:18.269292 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: WARNING keystonemiddleware.auth_token [None req-9b0f3747-f23c-4bf1-b0ee-9ad32c285cd7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 05:20:18.276113 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: WARNING keystonemiddleware.auth_token [None req-9b0f3747-f23c-4bf1-b0ee-9ad32c285cd7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 05:20:18.281528 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562758b249c0 pid: 117820 (default app) Jul 29 05:20:59.954734 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_api:SELECT=3 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:20:59.957490 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell0:SELECT=3 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:20:59.959866 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell1:SELECT=3 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:20:59.961913 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell0:SELECT=3 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:21:01.281011 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-ed8ae4e8-07d8-4129-ab85-d1becb48e4e6 tempest-VolumesGetTestJSON-563492988 tempest-VolumesGetTestJSON-563492988-project] Action: 'create', calling method: .version_select at 0x7fa640c7aee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1484173608", "metadata": {"Type": "work"}}} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:21:02.824684 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-ed8ae4e8-07d8-4129-ab85-d1becb48e4e6 tempest-VolumesGetTestJSON-563492988 tempest-VolumesGetTestJSON-563492988-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.889276 Jul 29 05:21:02.825645 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 1/1] 10.222.0.49 () {60 vars in 1156 bytes} [Fri Jul 29 05:20:59 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2892 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 29 05:21:03.139107 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-2a973c60-73eb-42af-9299-b0c2c5ead08b tempest-VolumesGetTestJSON-563492988 tempest-VolumesGetTestJSON-563492988-project] Calling method '.version_select at 0x7fa640d5ca60>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:03.210541 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_api:SELECT=3 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:21:03.213400 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell0:SELECT=3 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:21:03.218345 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell1:SELECT=3 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:21:03.219558 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell0:SELECT=3 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:21:03.935996 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-2a973c60-73eb-42af-9299-b0c2c5ead08b tempest-VolumesGetTestJSON-563492988 tempest-VolumesGetTestJSON-563492988-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/9d4234fb-09c0-4cbf-80f4-a009d8026204" status: 200 len: 354 microversion: 2.1 time: 1.094235 Jul 29 05:21:03.937355 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 1/2] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Jul 29 05:21:02 2022] GET /compute/v2.1/os-volumes/9d4234fb-09c0-4cbf-80f4-a009d8026204 => generated 354 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:21:03.962561 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-14ac03a0-89c1-435c-a8ec-d92b83d6cbc6 tempest-VolumesGetTestJSON-563492988 tempest-VolumesGetTestJSON-563492988-project] Calling method '.version_select at 0x7fa640affdc0>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:04.071649 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-14ac03a0-89c1-435c-a8ec-d92b83d6cbc6 tempest-VolumesGetTestJSON-563492988 tempest-VolumesGetTestJSON-563492988-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/9d4234fb-09c0-4cbf-80f4-a009d8026204" status: 200 len: 354 microversion: 2.1 time: 0.121095 Jul 29 05:21:04.089078 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-ed9fa9e3-708d-40ee-a37d-9c4e45f9fa3f tempest-VolumesGetTestJSON-563492988 tempest-VolumesGetTestJSON-563492988-project] Calling method '.version_select at 0x7fa640bacdc0>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:04.089582 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 2/3] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Jul 29 05:21:03 2022] GET /compute/v2.1/os-volumes/9d4234fb-09c0-4cbf-80f4-a009d8026204 => generated 354 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:21:04.282087 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-ed9fa9e3-708d-40ee-a37d-9c4e45f9fa3f tempest-VolumesGetTestJSON-563492988 tempest-VolumesGetTestJSON-563492988-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/9d4234fb-09c0-4cbf-80f4-a009d8026204" status: 202 len: 0 microversion: 2.1 time: 0.198418 Jul 29 05:21:04.342160 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 2/4] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Jul 29 05:21:04 2022] DELETE /compute/v2.1/os-volumes/9d4234fb-09c0-4cbf-80f4-a009d8026204 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 29 05:21:04.343110 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-172b05d2-1163-40a1-9f10-d888ec3720b4 tempest-VolumesGetTestJSON-563492988 tempest-VolumesGetTestJSON-563492988-project] Calling method '.version_select at 0x7fa640b124c0>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:04.408275 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-172b05d2-1163-40a1-9f10-d888ec3720b4 tempest-VolumesGetTestJSON-563492988 tempest-VolumesGetTestJSON-563492988-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/9d4234fb-09c0-4cbf-80f4-a009d8026204" status: 200 len: 353 microversion: 2.1 time: 0.119649 Jul 29 05:21:04.415874 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 3/5] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Jul 29 05:21:04 2022] GET /compute/v2.1/os-volumes/9d4234fb-09c0-4cbf-80f4-a009d8026204 => generated 353 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:21:05.424583 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-98f7c476-fd5c-40d7-a2c7-be6a0bd7e5fb tempest-VolumesGetTestJSON-563492988 tempest-VolumesGetTestJSON-563492988-project] Calling method '.version_select at 0x7fa640bacca0>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:05.484341 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.wsgi [None req-98f7c476-fd5c-40d7-a2c7-be6a0bd7e5fb tempest-VolumesGetTestJSON-563492988 tempest-VolumesGetTestJSON-563492988-project] HTTP exception thrown: Volume 9d4234fb-09c0-4cbf-80f4-a009d8026204 could not be found. Jul 29 05:21:05.488702 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-98f7c476-fd5c-40d7-a2c7-be6a0bd7e5fb tempest-VolumesGetTestJSON-563492988 tempest-VolumesGetTestJSON-563492988-project] Request method failure captured: Jul 29 05:21:05.488702 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: request: GET /compute/v2.1/os-volumes/9d4234fb-09c0-4cbf-80f4-a009d8026204 HTTP/1.1 Jul 29 05:21:05.488702 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept: application/json Jul 29 05:21:05.488702 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept-Encoding: identity Jul 29 05:21:05.488702 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Connection: close Jul 29 05:21:05.488702 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Length: 0 Jul 29 05:21:05.488702 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Type: application/json Jul 29 05:21:05.488702 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Host: 10.222.0.49 Jul 29 05:21:05.488702 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Openstack-System-Scope: None Jul 29 05:21:05.488702 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: User-Agent: python-urllib3/1.26.10 Jul 29 05:21:05.488702 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Auth-Token: gAAAAABi4247DUxw8ChBK3APyv9b9UAIgur9BB2pQmUgMROaKjnZ7hDTarQa_vduPLD5Ed3UyJkwT7J-T_16yCX7WFqxH1DQIzYT7YN_mi-m9zeiL14hVEOZmCQCZgUFrqu_7XW8X9if8gzXomLLTOd3L-DzOH6LndY03a0mfKPt22GF3JjKb-0 Jul 29 05:21:05.488702 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Id: None Jul 29 05:21:05.488702 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Name: None Jul 29 05:21:05.488702 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Identity-Status: Confirmed Jul 29 05:21:05.488702 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Is-Admin-Project: True Jul 29 05:21:05.488702 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Id: default Jul 29 05:21:05.488702 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Name: Default Jul 29 05:21:05.488702 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Id: 908a005339464b1dacebb2fa00e0a14e Jul 29 05:21:05.488702 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Name: tempest-VolumesGetTestJSON-563492988 Jul 29 05:21:05.488702 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Role: member,reader Jul 29 05:21:05.488702 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Roles: member,reader Jul 29 05:21:05.490005 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/908a005339464b1dacebb2fa00e0a14e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/908a005339464b1dacebb2fa00e0a14e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_908a005339464b1dacebb2fa00e0a14e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/908a005339464b1dacebb2fa00e0a14e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:21:05.490005 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant: tempest-VolumesGetTestJSON-563492988 Jul 29 05:21:05.490005 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Id: 908a005339464b1dacebb2fa00e0a14e Jul 29 05:21:05.490005 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Name: tempest-VolumesGetTestJSON-563492988 Jul 29 05:21:05.490005 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User: tempest-VolumesGetTestJSON-563492988-project Jul 29 05:21:05.490005 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Id: default Jul 29 05:21:05.490005 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Name: Default Jul 29 05:21:05.490005 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Id: 13be1d5917bc4a7ea41c83cce5c1e7f3 Jul 29 05:21:05.490005 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Name: tempest-VolumesGetTestJSON-563492988-project Jul 29 05:21:05.490005 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: method: Jul 29 05:21:05.490005 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: exception: Volume 9d4234fb-09c0-4cbf-80f4-a009d8026204 could not be found. Jul 29 05:21:05.490005 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: action_args: {'id': '9d4234fb-09c0-4cbf-80f4-a009d8026204'} Jul 29 05:21:05.490005 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:21:05.490720 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:21:05.490720 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 05:21:05.490720 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 05:21:05.490720 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 05:21:05.490720 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 05:21:05.490720 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 05:21:05.490720 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 05:21:05.490720 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 05:21:05.490720 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 05:21:05.490720 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 05:21:05.490720 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 05:21:05.490720 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 05:21:05.490720 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 05:21:05.490720 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 05:21:05.490720 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 05:21:05.490720 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9d4234fb-09c0-4cbf-80f4-a009d8026204 could not be found. (HTTP 404) (Request-ID: req-c17096cc-0fca-421f-8b4d-f80ca8419de5) Jul 29 05:21:05.490720 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:21:05.490720 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:21:05.490720 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:21:05.491563 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:21:05.491563 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 29 05:21:05.491563 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 29 05:21:05.491563 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 05:21:05.491563 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 05:21:05.491563 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 05:21:05.491563 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 05:21:05.491563 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 05:21:05.491563 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 05:21:05.491563 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 05:21:05.491563 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 05:21:05.491563 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 05:21:05.491563 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 05:21:05.491563 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 05:21:05.491563 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 05:21:05.491563 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 05:21:05.491563 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 05:21:05.491563 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 05:21:05.491563 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 05:21:05.492381 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 05:21:05.492381 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 05:21:05.492381 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 05:21:05.492381 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 05:21:05.492381 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9d4234fb-09c0-4cbf-80f4-a009d8026204 could not be found. Jul 29 05:21:05.492381 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:21:05.492381 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:21:05.492381 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:21:05.492381 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:21:05.492381 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:21:05.492381 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:21:05.492381 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:21:05.492381 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:21:05.492381 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 05:21:05.492381 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 05:21:05.492381 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:21:05.492381 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:21:05.492381 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 29 05:21:05.492381 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:21:05.493182 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9d4234fb-09c0-4cbf-80f4-a009d8026204 could not be found. Jul 29 05:21:05.493182 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:21:05.493182 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:21:05.493182 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:21:05.493182 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:21:05.493182 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:21:05.493182 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:21:05.493182 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:21:05.493182 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:21:05.493182 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9d4234fb-09c0-4cbf-80f4-a009d8026204 could not be found. Jul 29 05:21:05.493182 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:21:05.494414 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-98f7c476-fd5c-40d7-a2c7-be6a0bd7e5fb tempest-VolumesGetTestJSON-563492988 tempest-VolumesGetTestJSON-563492988-project] Returning 404 to user: Volume 9d4234fb-09c0-4cbf-80f4-a009d8026204 could not be found. {{(pid=117820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:21:05.495431 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-98f7c476-fd5c-40d7-a2c7-be6a0bd7e5fb tempest-VolumesGetTestJSON-563492988 tempest-VolumesGetTestJSON-563492988-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/9d4234fb-09c0-4cbf-80f4-a009d8026204" status: 404 len: 109 microversion: 2.1 time: 0.075255 Jul 29 05:21:05.496120 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 3/6] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Jul 29 05:21:05 2022] GET /compute/v2.1/os-volumes/9d4234fb-09c0-4cbf-80f4-a009d8026204 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:21:13.868080 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-c7e9ec6f-df38-48c5-a72f-027806b994ea tempest-VolumesTestJSON-1081730057 tempest-VolumesTestJSON-1081730057-project] Calling method '.version_select at 0x7fa641484430>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:14.060577 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-fa7a8f11-a5a9-4ef4-a910-d7983866ef8b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Action: 'create', calling method: .version_select at 0x7fa640b12a60>, body: {"keypair": {"name": "tempest-keypair-716991338", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1Uj/Tl+E5JJl0bovy2PhnuZQ6fhCrMWj6C43Eh57rn7kyjs2cBHs1Fj9iRwbo9D+Pp1gBWjP5m7PlUw+u/pNy/e731raM2U/F0+lmNmqmShqe6Uf7LmW8ILmU7cMEtkg=="}} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:21:14.168210 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.quota [None req-fa7a8f11-a5a9-4ef4-a910-d7983866ef8b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Getting quotas for project 9d8baaf2e23546ee8ed1de278617c7d2. Resources: {'key_pairs'} {{(pid=117821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:21:14.184031 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.quota [None req-fa7a8f11-a5a9-4ef4-a910-d7983866ef8b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Getting quotas for user 3c60b3a983f14f50b1b762a3954a1059 and project 9d8baaf2e23546ee8ed1de278617c7d2. Resources: {'key_pairs'} {{(pid=117821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:21:14.306409 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-fa7a8f11-a5a9-4ef4-a910-d7983866ef8b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.581848 Jul 29 05:21:14.307341 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 4/7] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Jul 29 05:21:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:21:14.388516 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-c7e9ec6f-df38-48c5-a72f-027806b994ea tempest-VolumesTestJSON-1081730057 tempest-VolumesTestJSON-1081730057-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/cde56159-70f6-4c6b-9449-cada45c62373" status: 200 len: 351 microversion: 2.1 time: 0.526248 Jul 29 05:21:14.407049 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 4/8] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Jul 29 05:21:13 2022] GET /compute/v2.1/os-volumes/cde56159-70f6-4c6b-9449-cada45c62373 => generated 351 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:21:16.237801 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-97330500-c2de-4524-9884-138892b51781 tempest-VolumesTestJSON-1081730057 tempest-VolumesTestJSON-1081730057-project] Calling method '.version_select at 0x7fa640a9f280>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:16.370103 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-97330500-c2de-4524-9884-138892b51781 tempest-VolumesTestJSON-1081730057 tempest-VolumesTestJSON-1081730057-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/7bd6bddb-d64b-40d6-af9e-c477d0b911ce" status: 200 len: 350 microversion: 2.1 time: 0.136439 Jul 29 05:21:16.370892 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 5/9] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Jul 29 05:21:16 2022] GET /compute/v2.1/os-volumes/7bd6bddb-d64b-40d6-af9e-c477d0b911ce => generated 350 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:21:18.129022 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-3971c4ad-7c1c-48a9-8c63-b856de962b1c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1776156004", "imageRef": "b7bf870d-4e7c-42fd-849f-72ac19277493", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:21:18.252699 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-d0cfc3c1-aa7e-4eba-ac27-89c89e869d27 tempest-VolumesTestJSON-1081730057 tempest-VolumesTestJSON-1081730057-project] Calling method '.version_select at 0x7fa640a9f8b0>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:18.368717 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-d0cfc3c1-aa7e-4eba-ac27-89c89e869d27 tempest-VolumesTestJSON-1081730057 tempest-VolumesTestJSON-1081730057-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/1a103b89-dd97-44ca-b6b9-e849cbe20ed5" status: 200 len: 350 microversion: 2.1 time: 0.120291 Jul 29 05:21:18.371507 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 6/10] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Jul 29 05:21:18 2022] GET /compute/v2.1/os-volumes/1a103b89-dd97-44ca-b6b9-e849cbe20ed5 => generated 350 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:21:18.394981 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-86e6af70-c93c-427d-9214-36e53ffce224 tempest-VolumesTestJSON-1081730057 tempest-VolumesTestJSON-1081730057-project] Calling method '.version_select at 0x7fa640a9ff70>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:18.477286 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.network.neutron [None req-3971c4ad-7c1c-48a9-8c63-b856de962b1c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] validate_networks() for [('71b5d5d0-8fbf-40b8-b58c-094f4ec4c2d9', None, None, None, None, None)] {{(pid=117820) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 05:21:18.596913 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-86e6af70-c93c-427d-9214-36e53ffce224 tempest-VolumesTestJSON-1081730057 tempest-VolumesTestJSON-1081730057-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.213541 Jul 29 05:21:18.597488 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 7/11] 10.222.0.49 () {58 vars in 1134 bytes} [Fri Jul 29 05:21:18 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:18.618189 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-5e543372-6ae2-4e81-a86f-1c02ebb52f0e tempest-VolumesTestJSON-1081730057 tempest-VolumesTestJSON-1081730057-project] Calling method '.version_select at 0x7fa640a9f430>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:18.789147 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-5e543372-6ae2-4e81-a86f-1c02ebb52f0e tempest-VolumesTestJSON-1081730057 tempest-VolumesTestJSON-1081730057-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.180391 Jul 29 05:21:18.790470 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 8/12] 10.222.0.49 () {58 vars in 1149 bytes} [Fri Jul 29 05:21:18 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:21:18.805596 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-078b5f31-d42a-4f52-b321-6c971377cffe tempest-VolumesTestJSON-1081730057 tempest-VolumesTestJSON-1081730057-project] Calling method '.version_select at 0x7fa640aad040>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:19.026245 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-078b5f31-d42a-4f52-b321-6c971377cffe tempest-VolumesTestJSON-1081730057 tempest-VolumesTestJSON-1081730057-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.226491 Jul 29 05:21:19.026828 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 9/13] 10.222.0.49 () {58 vars in 1134 bytes} [Fri Jul 29 05:21:18 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:21:19.040825 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-b0b06a8f-3d7e-48c8-9a90-2fbe0075e487 tempest-VolumesTestJSON-1081730057 tempest-VolumesTestJSON-1081730057-project] Calling method '.version_select at 0x7fa640aaeca0>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:19.259806 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-b0b06a8f-3d7e-48c8-9a90-2fbe0075e487 tempest-VolumesTestJSON-1081730057 tempest-VolumesTestJSON-1081730057-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.223759 Jul 29 05:21:19.260847 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 10/14] 10.222.0.49 () {58 vars in 1167 bytes} [Fri Jul 29 05:21:19 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:21:19.277663 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-8ebfb093-5ce9-4229-9c47-11edd4624cdb tempest-VolumesTestJSON-1081730057 tempest-VolumesTestJSON-1081730057-project] Calling method '.version_select at 0x7fa640a9f5e0>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:19.475104 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-8ebfb093-5ce9-4229-9c47-11edd4624cdb tempest-VolumesTestJSON-1081730057 tempest-VolumesTestJSON-1081730057-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.203267 Jul 29 05:21:19.477016 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 11/15] 10.222.0.49 () {58 vars in 1170 bytes} [Fri Jul 29 05:21:19 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:21:19.496065 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-47f6a40b-3edf-4d31-b461-6fa88449850b tempest-VolumesTestJSON-1081730057 tempest-VolumesTestJSON-1081730057-project] Calling method '.version_select at 0x7fa640aadf70>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:19.700583 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-47f6a40b-3edf-4d31-b461-6fa88449850b tempest-VolumesTestJSON-1081730057 tempest-VolumesTestJSON-1081730057-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.214096 Jul 29 05:21:19.701501 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 12/16] 10.222.0.49 () {58 vars in 1155 bytes} [Fri Jul 29 05:21:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:19.720055 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-e7d10708-536c-4bcf-ba5c-317312b829e1 tempest-VolumesTestJSON-1081730057 tempest-VolumesTestJSON-1081730057-project] Calling method '.version_select at 0x7fa640aaddc0>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:20.062261 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-e7d10708-536c-4bcf-ba5c-317312b829e1 tempest-VolumesTestJSON-1081730057 tempest-VolumesTestJSON-1081730057-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.349277 Jul 29 05:21:20.062861 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 13/17] 10.222.0.49 () {58 vars in 1188 bytes} [Fri Jul 29 05:21:19 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:21:20.077610 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-d7d871e6-2928-420a-9649-1f84e6f1d011 tempest-VolumesTestJSON-1081730057 tempest-VolumesTestJSON-1081730057-project] Calling method '.version_select at 0x7fa640aae670>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:20.307684 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-d7d871e6-2928-420a-9649-1f84e6f1d011 tempest-VolumesTestJSON-1081730057 tempest-VolumesTestJSON-1081730057-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.234782 Jul 29 05:21:20.309113 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 14/18] 10.222.0.49 () {58 vars in 1155 bytes} [Fri Jul 29 05:21:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:21:20.714776 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-fbb88367-607a-4832-8d6c-e3d907038189 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-961167343", "imageRef": "b7bf870d-4e7c-42fd-849f-72ac19277493", "flavorRef": "452", "networks": [{"uuid": "b0621011-00a8-43df-ac92-ce1f2af05d6a"}]}} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:21:20.992629 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.network.neutron [None req-fbb88367-607a-4832-8d6c-e3d907038189 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] validate_networks() for [('b0621011-00a8-43df-ac92-ce1f2af05d6a', None, None, None, None, None)] {{(pid=117821) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 05:21:21.152399 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-3971c4ad-7c1c-48a9-8c63-b856de962b1c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Flavor limits 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 05:21:21.154323 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-3971c4ad-7c1c-48a9-8c63-b856de962b1c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Image limits 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 05:21:21.155012 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-3971c4ad-7c1c-48a9-8c63-b856de962b1c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Flavor pref 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 05:21:21.155654 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-3971c4ad-7c1c-48a9-8c63-b856de962b1c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Image pref 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 05:21:21.156490 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-3971c4ad-7c1c-48a9-8c63-b856de962b1c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 05:21:21.194101 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3971c4ad-7c1c-48a9-8c63-b856de962b1c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:21.195160 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3971c4ad-7c1c-48a9-8c63-b856de962b1c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:21.196657 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3971c4ad-7c1c-48a9-8c63-b856de962b1c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:21.198899 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3971c4ad-7c1c-48a9-8c63-b856de962b1c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:21.304984 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.quota [None req-3971c4ad-7c1c-48a9-8c63-b856de962b1c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Getting quotas for project 153fe5d9d64346f6b7419eba91948678. Resources: {'instances', 'ram', 'cores'} {{(pid=117820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:21:21.324942 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.quota [None req-3971c4ad-7c1c-48a9-8c63-b856de962b1c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Getting quotas for user 45ae88234e984149be8539757efa8733 and project 153fe5d9d64346f6b7419eba91948678. Resources: {'instances', 'ram', 'cores'} {{(pid=117820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:21:21.366981 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-3971c4ad-7c1c-48a9-8c63-b856de962b1c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Going to run 1 instances... {{(pid=117820) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 05:21:21.374267 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-3971c4ad-7c1c-48a9-8c63-b856de962b1c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b7bf870d-4e7c-42fd-849f-72ac19277493',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117820) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 05:21:21.565057 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-3971c4ad-7c1c-48a9-8c63-b856de962b1c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.845407 Jul 29 05:21:21.574408 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 5/19] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 05:21:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 3855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 05:21:21.585089 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-15730ed5-d3fc-45a7-a322-ff48d38a57d6 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:21.585726 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-15730ed5-d3fc-45a7-a322-ff48d38a57d6 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:21.762971 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-15730ed5-d3fc-45a7-a322-ff48d38a57d6 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:21.834738 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-15730ed5-d3fc-45a7-a322-ff48d38a57d6 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1222 microversion: 2.1 time: 0.258495 Jul 29 05:21:21.856820 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 6/20] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:21 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1222 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:22.183157 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-e934f657-4c32-416a-9843-a099319ae616 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-695086610", "imageRef": "b7bf870d-4e7c-42fd-849f-72ac19277493", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:21:22.355746 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.network.neutron [None req-e934f657-4c32-416a-9843-a099319ae616 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] validate_networks() for [('71b5d5d0-8fbf-40b8-b58c-094f4ec4c2d9', None, None, None, None, None)] {{(pid=117820) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 05:21:24.037567 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-fbb88367-607a-4832-8d6c-e3d907038189 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Flavor limits 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 05:21:24.038595 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-fbb88367-607a-4832-8d6c-e3d907038189 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Image limits 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 05:21:24.039555 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-fbb88367-607a-4832-8d6c-e3d907038189 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Flavor pref 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 05:21:24.040104 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-fbb88367-607a-4832-8d6c-e3d907038189 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Image pref 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 05:21:24.040700 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-fbb88367-607a-4832-8d6c-e3d907038189 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 05:21:24.063001 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-fbb88367-607a-4832-8d6c-e3d907038189 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:24.067585 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-fbb88367-607a-4832-8d6c-e3d907038189 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:24.068657 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-fbb88367-607a-4832-8d6c-e3d907038189 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:24.073461 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-fbb88367-607a-4832-8d6c-e3d907038189 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:24.184259 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.quota [None req-fbb88367-607a-4832-8d6c-e3d907038189 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Getting quotas for project c87396f5e6bf46f5b85720c8e365da81. Resources: {'instances', 'ram', 'cores'} {{(pid=117821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:21:24.195052 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.quota [None req-fbb88367-607a-4832-8d6c-e3d907038189 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Getting quotas for user 720be309cbe14940873d774b06e91bf9 and project c87396f5e6bf46f5b85720c8e365da81. Resources: {'instances', 'ram', 'cores'} {{(pid=117821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:21:24.237298 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-fbb88367-607a-4832-8d6c-e3d907038189 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Going to run 1 instances... {{(pid=117821) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 05:21:24.241723 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-fbb88367-607a-4832-8d6c-e3d907038189 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] [instance: 51207b24-620a-4479-be28-4db53ef4073e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b7bf870d-4e7c-42fd-849f-72ac19277493',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117821) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 05:21:24.528230 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-fbb88367-607a-4832-8d6c-e3d907038189 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.198326 Jul 29 05:21:24.538647 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 15/21] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 05:21:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 4203 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 05:21:24.582976 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-b41182d7-8e68-4008-be78-0b6b959f783e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1406506444", "imageRef": "b7bf870d-4e7c-42fd-849f-72ac19277493", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b55efc63-6791-470d-af15-935a2f0fc83e"}], "security_groups": [{"name": "tempest-securitygroup--724388671"}], "key_name": "tempest-keypair-716991338", "user_data": "}} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:21:24.604110 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-e934f657-4c32-416a-9843-a099319ae616 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Flavor limits 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 05:21:24.606003 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-e934f657-4c32-416a-9843-a099319ae616 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Image limits 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 05:21:24.607185 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-e934f657-4c32-416a-9843-a099319ae616 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Flavor pref 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 05:21:24.608203 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-e934f657-4c32-416a-9843-a099319ae616 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Image pref 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 05:21:24.609725 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-e934f657-4c32-416a-9843-a099319ae616 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 05:21:24.649878 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e934f657-4c32-416a-9843-a099319ae616 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:24.651186 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e934f657-4c32-416a-9843-a099319ae616 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:24.662145 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e934f657-4c32-416a-9843-a099319ae616 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:24.664017 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e934f657-4c32-416a-9843-a099319ae616 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:24.756380 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.quota [None req-e934f657-4c32-416a-9843-a099319ae616 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Getting quotas for project 153fe5d9d64346f6b7419eba91948678. Resources: {'instances', 'ram', 'cores'} {{(pid=117820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:21:24.781549 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.quota [None req-e934f657-4c32-416a-9843-a099319ae616 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Getting quotas for user 45ae88234e984149be8539757efa8733 and project 153fe5d9d64346f6b7419eba91948678. Resources: {'instances', 'ram', 'cores'} {{(pid=117820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:21:24.869924 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-e934f657-4c32-416a-9843-a099319ae616 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Going to run 1 instances... {{(pid=117820) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 05:21:24.878241 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-e934f657-4c32-416a-9843-a099319ae616 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b7bf870d-4e7c-42fd-849f-72ac19277493',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117820) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 05:21:25.017791 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-e934f657-4c32-416a-9843-a099319ae616 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.839147 Jul 29 05:21:25.018797 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 7/22] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 05:21:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 2841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 29 05:21:25.027110 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-ede653b1-afff-4e2f-852c-b32963686a5b tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:25.029408 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-ede653b1-afff-4e2f-852c-b32963686a5b tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] [instance: 51207b24-620a-4479-be28-4db53ef4073e] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:25.482395 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.network.neutron [None req-b41182d7-8e68-4008-be78-0b6b959f783e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] validate_networks() for [('b55efc63-6791-470d-af15-935a2f0fc83e', None, None, None, None, None)] {{(pid=117821) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 05:21:25.914471 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-ede653b1-afff-4e2f-852c-b32963686a5b tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720be309cbe14940873d774b06e91bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87396f5e6bf46f5b85720c8e365da81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:25.941481 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-ede653b1-afff-4e2f-852c-b32963686a5b tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] 10.222.0.49 "GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e" status: 200 len: 1214 microversion: 2.1 time: 0.920925 Jul 29 05:21:25.943536 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 8/23] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:25 2022] GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e => generated 1214 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:25.954381 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-7f149917-1673-4de2-aef0-b164b74b4508 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:25.955979 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-7f149917-1673-4de2-aef0-b164b74b4508 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:26.151209 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-7f149917-1673-4de2-aef0-b164b74b4508 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:26.180266 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-7f149917-1673-4de2-aef0-b164b74b4508 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1221 microversion: 2.1 time: 0.228810 Jul 29 05:21:26.183377 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 9/24] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:25 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1221 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:27.398161 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-0df5315b-91e5-4cfa-bc81-b189283b94fd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Action: 'create', calling method: .version_select at 0x7fa6401acd30>, body: {"keypair": {"name": "tempest-keypair-491656657", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJpk+ztU0Ah0YHhHnTxX/HOn3BST/eLHJA4GEwotZV8unVTTs8USYV5k/vqasaa6Kmo1IDwuozhAxypt54fty0DamKg54HY8c3KL0D9vFi4XM/z/xPE2duFENJRlRJEXNA=="}} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:21:27.546300 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.quota [None req-0df5315b-91e5-4cfa-bc81-b189283b94fd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Getting quotas for project 9fda8c6d9ffa4955b2f19411ee340cb3. Resources: {'key_pairs'} {{(pid=117820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:21:27.565513 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.quota [None req-0df5315b-91e5-4cfa-bc81-b189283b94fd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Getting quotas for user af5a109a6fb94042aeacbf141d7322ef and project 9fda8c6d9ffa4955b2f19411ee340cb3. Resources: {'key_pairs'} {{(pid=117820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:21:27.638167 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-0df5315b-91e5-4cfa-bc81-b189283b94fd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.844340 Jul 29 05:21:27.639023 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 10/25] 10.222.0.49 () {62 vars in 1200 bytes} [Fri Jul 29 05:21:26 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 846 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 29 05:21:27.651861 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-eb936648-7182-486c-bda4-eab66097cc24 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:27.652897 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-eb936648-7182-486c-bda4-eab66097cc24 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] [instance: 51207b24-620a-4479-be28-4db53ef4073e] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:27.668197 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-eb936648-7182-486c-bda4-eab66097cc24 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:27.668924 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-eb936648-7182-486c-bda4-eab66097cc24 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:27.670533 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-eb936648-7182-486c-bda4-eab66097cc24 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:27.671200 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-eb936648-7182-486c-bda4-eab66097cc24 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:28.367826 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-eb936648-7182-486c-bda4-eab66097cc24 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720be309cbe14940873d774b06e91bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87396f5e6bf46f5b85720c8e365da81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:28.407936 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-eb936648-7182-486c-bda4-eab66097cc24 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] 10.222.0.49 "GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e" status: 200 len: 1210 microversion: 2.1 time: 0.767560 Jul 29 05:21:28.408573 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 11/26] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:27 2022] GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e => generated 1210 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:28.458707 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-a7b48bfa-08c4-46c1-9f26-ab9071589dab tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:28.459646 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-a7b48bfa-08c4-46c1-9f26-ab9071589dab tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:28.478065 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a7b48bfa-08c4-46c1-9f26-ab9071589dab tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:28.478746 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a7b48bfa-08c4-46c1-9f26-ab9071589dab tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:28.479899 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a7b48bfa-08c4-46c1-9f26-ab9071589dab tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:28.480482 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a7b48bfa-08c4-46c1-9f26-ab9071589dab tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:29.249541 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-b41182d7-8e68-4008-be78-0b6b959f783e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Flavor limits 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 05:21:29.250071 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-b41182d7-8e68-4008-be78-0b6b959f783e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Image limits 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 05:21:29.250540 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-b41182d7-8e68-4008-be78-0b6b959f783e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Flavor pref 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 05:21:29.250852 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-b41182d7-8e68-4008-be78-0b6b959f783e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Image pref 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 05:21:29.251265 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-b41182d7-8e68-4008-be78-0b6b959f783e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 05:21:29.283112 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b41182d7-8e68-4008-be78-0b6b959f783e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:29.284830 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b41182d7-8e68-4008-be78-0b6b959f783e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:29.286094 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b41182d7-8e68-4008-be78-0b6b959f783e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:29.290326 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b41182d7-8e68-4008-be78-0b6b959f783e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:29.296012 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-a7b48bfa-08c4-46c1-9f26-ab9071589dab tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:29.310317 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-a7b48bfa-08c4-46c1-9f26-ab9071589dab tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1281 microversion: 2.1 time: 0.900644 Jul 29 05:21:29.315715 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 12/27] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:28 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1281 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:29.391668 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.quota [None req-b41182d7-8e68-4008-be78-0b6b959f783e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Getting quotas for project 9d8baaf2e23546ee8ed1de278617c7d2. Resources: {'instances', 'ram', 'cores'} {{(pid=117821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:21:29.400802 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.quota [None req-b41182d7-8e68-4008-be78-0b6b959f783e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Getting quotas for user 3c60b3a983f14f50b1b762a3954a1059 and project 9d8baaf2e23546ee8ed1de278617c7d2. Resources: {'instances', 'ram', 'cores'} {{(pid=117821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:21:29.469438 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-b41182d7-8e68-4008-be78-0b6b959f783e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Going to run 1 instances... {{(pid=117821) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 05:21:29.474899 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-b41182d7-8e68-4008-be78-0b6b959f783e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b7bf870d-4e7c-42fd-849f-72ac19277493',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117821) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 05:21:29.633576 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-b41182d7-8e68-4008-be78-0b6b959f783e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.097869 Jul 29 05:21:29.642831 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 16/28] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 05:21:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 5111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 05:21:29.659952 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-297b8897-1db1-4c79-9135-f1fc5c4e1f4b tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:29.666059 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-297b8897-1db1-4c79-9135-f1fc5c4e1f4b tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] [instance: 51207b24-620a-4479-be28-4db53ef4073e] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:29.747888 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-297b8897-1db1-4c79-9135-f1fc5c4e1f4b tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:29.751658 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-297b8897-1db1-4c79-9135-f1fc5c4e1f4b tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:29.769031 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-297b8897-1db1-4c79-9135-f1fc5c4e1f4b tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:29.771307 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-297b8897-1db1-4c79-9135-f1fc5c4e1f4b tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:29.867707 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-002c7dfe-149f-4af7-8db9-389dee427450 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Action: 'create', calling method: .version_select at 0x7fa6400e98b0>, body: {"keypair": {"name": "tempest-keypair-707859948", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdXJwIGA8qQ674cOXqDUVtrcf7oW6fvVpL3HITDDzlTEaTFu2lDNMGKrle9SEVSjnlBVDUQ/5OnhPjyZlfYH8TJe3h9gkxCm4In+e25fGJmlEfGto6NqOCrTVMAIl3GLg=="}} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:21:29.948767 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.quota [None req-002c7dfe-149f-4af7-8db9-389dee427450 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Getting quotas for project 92f16adc2357459aa0afb68db89031dd. Resources: {'key_pairs'} {{(pid=117820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:21:29.966245 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.quota [None req-002c7dfe-149f-4af7-8db9-389dee427450 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Getting quotas for user c2db6ada97da4ee89f3ce8de98f2653a and project 92f16adc2357459aa0afb68db89031dd. Resources: {'key_pairs'} {{(pid=117820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:21:30.089417 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-002c7dfe-149f-4af7-8db9-389dee427450 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.765189 Jul 29 05:21:30.091147 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 13/29] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Jul 29 05:21:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:21:30.108239 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-e4585157-c888-4bf8-ab9d-c6eb8e582f5c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:30.108864 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-e4585157-c888-4bf8-ab9d-c6eb8e582f5c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:30.558256 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-e4585157-c888-4bf8-ab9d-c6eb8e582f5c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:30.570466 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-e4585157-c888-4bf8-ab9d-c6eb8e582f5c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780" status: 200 len: 1241 microversion: 2.1 time: 0.474772 Jul 29 05:21:30.571326 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 14/30] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:30 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 => generated 1241 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:30.589741 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-aa299439-ef9e-4aea-ab3f-ce88c73a4a22 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:30.606907 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-aa299439-ef9e-4aea-ab3f-ce88c73a4a22 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:30.645397 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-aa299439-ef9e-4aea-ab3f-ce88c73a4a22 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:30.652191 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-aa299439-ef9e-4aea-ab3f-ce88c73a4a22 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:30.654960 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-aa299439-ef9e-4aea-ab3f-ce88c73a4a22 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:30.660651 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-aa299439-ef9e-4aea-ab3f-ce88c73a4a22 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:31.250727 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-297b8897-1db1-4c79-9135-f1fc5c4e1f4b tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720be309cbe14940873d774b06e91bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87396f5e6bf46f5b85720c8e365da81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:31.357721 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-297b8897-1db1-4c79-9135-f1fc5c4e1f4b tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] 10.222.0.49 "GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e" status: 200 len: 1272 microversion: 2.1 time: 1.713026 Jul 29 05:21:31.367432 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 17/31] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:29 2022] GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e => generated 1272 bytes in 1723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:31.598503 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-0427b3e1-1167-4e87-be0b-fc61984cbc95 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:31.599398 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-0427b3e1-1167-4e87-be0b-fc61984cbc95 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:31.616666 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0427b3e1-1167-4e87-be0b-fc61984cbc95 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:31.619317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0427b3e1-1167-4e87-be0b-fc61984cbc95 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:31.625616 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0427b3e1-1167-4e87-be0b-fc61984cbc95 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:31.629615 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0427b3e1-1167-4e87-be0b-fc61984cbc95 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:31.974415 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-aa299439-ef9e-4aea-ab3f-ce88c73a4a22 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:31.979326 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-0427b3e1-1167-4e87-be0b-fc61984cbc95 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:32.002444 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-0427b3e1-1167-4e87-be0b-fc61984cbc95 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780" status: 200 len: 1293 microversion: 2.1 time: 0.408596 Jul 29 05:21:32.007803 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-aa299439-ef9e-4aea-ab3f-ce88c73a4a22 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1279 microversion: 2.1 time: 1.425585 Jul 29 05:21:32.007803 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 15/32] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:30 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1279 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:32.009402 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 18/33] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:31 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 => generated 1293 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:32.382682 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-a18c8c5c-c8bd-45d7-bbeb-5ababf8fe15f tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:32.383814 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-a18c8c5c-c8bd-45d7-bbeb-5ababf8fe15f tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] [instance: 51207b24-620a-4479-be28-4db53ef4073e] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:32.401523 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a18c8c5c-c8bd-45d7-bbeb-5ababf8fe15f tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:32.408347 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a18c8c5c-c8bd-45d7-bbeb-5ababf8fe15f tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:32.414520 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a18c8c5c-c8bd-45d7-bbeb-5ababf8fe15f tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:32.418482 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a18c8c5c-c8bd-45d7-bbeb-5ababf8fe15f tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:33.043209 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-ccc5aafe-1485-4d19-81c9-1864eaf0bc45 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:33.045478 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-ccc5aafe-1485-4d19-81c9-1864eaf0bc45 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:33.061938 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ccc5aafe-1485-4d19-81c9-1864eaf0bc45 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:33.062557 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ccc5aafe-1485-4d19-81c9-1864eaf0bc45 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:33.068762 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ccc5aafe-1485-4d19-81c9-1864eaf0bc45 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:33.069276 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ccc5aafe-1485-4d19-81c9-1864eaf0bc45 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:33.159223 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-a18c8c5c-c8bd-45d7-bbeb-5ababf8fe15f tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720be309cbe14940873d774b06e91bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87396f5e6bf46f5b85720c8e365da81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:33.172764 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-a18c8c5c-c8bd-45d7-bbeb-5ababf8fe15f tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] 10.222.0.49 "GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e" status: 200 len: 1272 microversion: 2.1 time: 0.790361 Jul 29 05:21:33.194308 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 16/34] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:32 2022] GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e => generated 1272 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:33.205834 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-be6a7772-8247-4cc8-a8a5-fcce57a22590 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:33.209090 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-be6a7772-8247-4cc8-a8a5-fcce57a22590 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:33.230121 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-be6a7772-8247-4cc8-a8a5-fcce57a22590 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:33.232206 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-be6a7772-8247-4cc8-a8a5-fcce57a22590 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:33.233222 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-be6a7772-8247-4cc8-a8a5-fcce57a22590 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:33.233809 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-be6a7772-8247-4cc8-a8a5-fcce57a22590 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:33.704276 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-be6a7772-8247-4cc8-a8a5-fcce57a22590 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:33.711759 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-ccc5aafe-1485-4d19-81c9-1864eaf0bc45 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:33.727072 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-be6a7772-8247-4cc8-a8a5-fcce57a22590 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780" status: 200 len: 1299 microversion: 2.1 time: 0.529603 Jul 29 05:21:33.728900 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 17/35] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:33 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 => generated 1299 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:33.764060 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-ccc5aafe-1485-4d19-81c9-1864eaf0bc45 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1279 microversion: 2.1 time: 0.725159 Jul 29 05:21:33.770465 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 19/36] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:33 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1279 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:34.194791 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-895b70cc-05b1-46a1-a797-eae232f695c6 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:34.195743 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-895b70cc-05b1-46a1-a797-eae232f695c6 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] [instance: 51207b24-620a-4479-be28-4db53ef4073e] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:34.211447 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-895b70cc-05b1-46a1-a797-eae232f695c6 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:34.212295 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-895b70cc-05b1-46a1-a797-eae232f695c6 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:34.213145 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-895b70cc-05b1-46a1-a797-eae232f695c6 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:34.213596 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-895b70cc-05b1-46a1-a797-eae232f695c6 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:34.712694 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell0:SELECT=4 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:21:34.754642 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-1cb7abf3-9b91-4014-a657-4ce323eae011 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:34.756080 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-1cb7abf3-9b91-4014-a657-4ce323eae011 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:34.767447 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1cb7abf3-9b91-4014-a657-4ce323eae011 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:34.768177 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1cb7abf3-9b91-4014-a657-4ce323eae011 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:34.776477 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1cb7abf3-9b91-4014-a657-4ce323eae011 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:34.777533 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1cb7abf3-9b91-4014-a657-4ce323eae011 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:35.039265 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-895b70cc-05b1-46a1-a797-eae232f695c6 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720be309cbe14940873d774b06e91bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87396f5e6bf46f5b85720c8e365da81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:35.048806 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-895b70cc-05b1-46a1-a797-eae232f695c6 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] 10.222.0.49 "GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e" status: 200 len: 1272 microversion: 2.1 time: 0.855148 Jul 29 05:21:35.049673 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 18/37] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:34 2022] GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e => generated 1272 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:35.072716 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-b1b893f7-298a-42f2-92cf-48c66a6f1a11 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:35.073714 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-b1b893f7-298a-42f2-92cf-48c66a6f1a11 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:35.083424 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b1b893f7-298a-42f2-92cf-48c66a6f1a11 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:35.084161 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b1b893f7-298a-42f2-92cf-48c66a6f1a11 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:35.085307 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b1b893f7-298a-42f2-92cf-48c66a6f1a11 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:35.085907 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b1b893f7-298a-42f2-92cf-48c66a6f1a11 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:35.130424 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-1cb7abf3-9b91-4014-a657-4ce323eae011 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:35.139718 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-1cb7abf3-9b91-4014-a657-4ce323eae011 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780" status: 200 len: 1299 microversion: 2.1 time: 0.388240 Jul 29 05:21:35.141828 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 20/38] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:34 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 => generated 1299 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:36.071312 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-7a47507d-d2a6-40da-a864-280596bdb0a9 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:36.072817 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-7a47507d-d2a6-40da-a864-280596bdb0a9 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] [instance: 51207b24-620a-4479-be28-4db53ef4073e] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:36.083172 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7a47507d-d2a6-40da-a864-280596bdb0a9 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:36.085472 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7a47507d-d2a6-40da-a864-280596bdb0a9 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:36.104674 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7a47507d-d2a6-40da-a864-280596bdb0a9 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:36.108060 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7a47507d-d2a6-40da-a864-280596bdb0a9 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:37.116616 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-b1b893f7-298a-42f2-92cf-48c66a6f1a11 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:37.127744 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-b1b893f7-298a-42f2-92cf-48c66a6f1a11 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1321 microversion: 2.1 time: 2.074738 Jul 29 05:21:37.136815 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 19/39] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:35 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1321 bytes in 2084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:37.157684 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-0e9d0977-b721-4e3a-952b-e9e16f90efb0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:37.158394 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-0e9d0977-b721-4e3a-952b-e9e16f90efb0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:37.193768 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0e9d0977-b721-4e3a-952b-e9e16f90efb0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:37.195202 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0e9d0977-b721-4e3a-952b-e9e16f90efb0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:37.197880 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0e9d0977-b721-4e3a-952b-e9e16f90efb0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:37.199911 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0e9d0977-b721-4e3a-952b-e9e16f90efb0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:37.459321 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-7a47507d-d2a6-40da-a864-280596bdb0a9 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720be309cbe14940873d774b06e91bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87396f5e6bf46f5b85720c8e365da81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:37.469923 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-7a47507d-d2a6-40da-a864-280596bdb0a9 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] 10.222.0.49 "GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e" status: 200 len: 1314 microversion: 2.1 time: 1.402557 Jul 29 05:21:37.473149 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 21/40] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:36 2022] GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e => generated 1314 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:37.965771 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-0e9d0977-b721-4e3a-952b-e9e16f90efb0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:37.979605 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-0e9d0977-b721-4e3a-952b-e9e16f90efb0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780" status: 200 len: 1299 microversion: 2.1 time: 0.835627 Jul 29 05:21:37.994835 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 20/41] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:37 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 => generated 1299 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:38.168843 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-ce3730d2-f237-4f41-a5a8-6ccf31405cfc tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:38.169476 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-ce3730d2-f237-4f41-a5a8-6ccf31405cfc tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:38.183261 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ce3730d2-f237-4f41-a5a8-6ccf31405cfc tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:38.185440 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ce3730d2-f237-4f41-a5a8-6ccf31405cfc tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:38.186260 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ce3730d2-f237-4f41-a5a8-6ccf31405cfc tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:38.186733 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ce3730d2-f237-4f41-a5a8-6ccf31405cfc tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:38.496977 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-2c57df5e-0446-410b-abdd-fbebd8ac4ada tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:38.497593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-2c57df5e-0446-410b-abdd-fbebd8ac4ada tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] [instance: 51207b24-620a-4479-be28-4db53ef4073e] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:38.513303 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2c57df5e-0446-410b-abdd-fbebd8ac4ada tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:38.520268 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2c57df5e-0446-410b-abdd-fbebd8ac4ada tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:38.521447 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2c57df5e-0446-410b-abdd-fbebd8ac4ada tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:38.522059 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2c57df5e-0446-410b-abdd-fbebd8ac4ada tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:39.322188 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell0:SELECT=4 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:21:39.446454 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell0:SELECT=16 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:21:39.529129 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-ce3730d2-f237-4f41-a5a8-6ccf31405cfc tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:39.538787 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-ce3730d2-f237-4f41-a5a8-6ccf31405cfc tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1321 microversion: 2.1 time: 1.381971 Jul 29 05:21:39.560277 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 22/42] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:38 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1321 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:39.577906 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-66608827-bb89-46dc-8f16-9aac9eb440f9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:39.580095 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-66608827-bb89-46dc-8f16-9aac9eb440f9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:39.596054 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-66608827-bb89-46dc-8f16-9aac9eb440f9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:39.599063 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-66608827-bb89-46dc-8f16-9aac9eb440f9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:39.603035 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-66608827-bb89-46dc-8f16-9aac9eb440f9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:39.604088 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-66608827-bb89-46dc-8f16-9aac9eb440f9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:39.921933 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-66608827-bb89-46dc-8f16-9aac9eb440f9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:39.950564 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-66608827-bb89-46dc-8f16-9aac9eb440f9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780" status: 200 len: 1299 microversion: 2.1 time: 0.386047 Jul 29 05:21:39.970266 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 23/43] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:39 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 => generated 1299 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:40.358071 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-2c57df5e-0446-410b-abdd-fbebd8ac4ada tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720be309cbe14940873d774b06e91bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87396f5e6bf46f5b85720c8e365da81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:40.377322 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-2c57df5e-0446-410b-abdd-fbebd8ac4ada tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] 10.222.0.49 "GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e" status: 200 len: 1314 microversion: 2.1 time: 1.884119 Jul 29 05:21:40.389618 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 21/44] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:38 2022] GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e => generated 1314 bytes in 1897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:21:40.560088 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-4e2d0761-bf5b-474b-acd8-e505529ee589 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:40.560818 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-4e2d0761-bf5b-474b-acd8-e505529ee589 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:40.568836 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4e2d0761-bf5b-474b-acd8-e505529ee589 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:40.569558 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4e2d0761-bf5b-474b-acd8-e505529ee589 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:40.570573 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4e2d0761-bf5b-474b-acd8-e505529ee589 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:40.571205 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4e2d0761-bf5b-474b-acd8-e505529ee589 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:40.980465 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-e7880c49-70e2-4285-9197-fc48dc576d73 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:40.981243 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-e7880c49-70e2-4285-9197-fc48dc576d73 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:40.993133 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell0:SELECT=28 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:21:40.999042 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e7880c49-70e2-4285-9197-fc48dc576d73 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:41.000102 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e7880c49-70e2-4285-9197-fc48dc576d73 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:41.001086 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e7880c49-70e2-4285-9197-fc48dc576d73 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:41.002890 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e7880c49-70e2-4285-9197-fc48dc576d73 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:43.293983 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-e7880c49-70e2-4285-9197-fc48dc576d73 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:43.323484 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-e7880c49-70e2-4285-9197-fc48dc576d73 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780" status: 200 len: 1366 microversion: 2.1 time: 2.346915 Jul 29 05:21:43.335393 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 22/45] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:40 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 => generated 1366 bytes in 2349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:43.339759 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-130a9be9-d58d-4bf9-ab49-997258c0f7bf tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:43.340387 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-130a9be9-d58d-4bf9-ab49-997258c0f7bf tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] [instance: 51207b24-620a-4479-be28-4db53ef4073e] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:43.343823 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-4e2d0761-bf5b-474b-acd8-e505529ee589 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:43.363841 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-130a9be9-d58d-4bf9-ab49-997258c0f7bf tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:43.364298 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-130a9be9-d58d-4bf9-ab49-997258c0f7bf tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:43.365112 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-130a9be9-d58d-4bf9-ab49-997258c0f7bf tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:43.365565 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-130a9be9-d58d-4bf9-ab49-997258c0f7bf tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:43.376863 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-4e2d0761-bf5b-474b-acd8-e505529ee589 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1321 microversion: 2.1 time: 2.818399 Jul 29 05:21:43.393605 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 24/46] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:40 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1321 bytes in 2826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:43.590583 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-b0d07096-bebc-4f23-bf6e-684ee0db3c0d req-9eecd0c1-f58b-4fac-94f0-ed837b94bf86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f080dde-4e70-4d3f-aa8c-ced0a1065d3d", "tag": "add97173-f389-4e35-b131-c4e58524e3c9"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:21:43.635789 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-b0d07096-bebc-4f23-bf6e-684ee0db3c0d req-9eecd0c1-f58b-4fac-94f0-ed837b94bf86 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:43.636484 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-b0d07096-bebc-4f23-bf6e-684ee0db3c0d req-9eecd0c1-f58b-4fac-94f0-ed837b94bf86 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:43.715264 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-b0d07096-bebc-4f23-bf6e-684ee0db3c0d req-9eecd0c1-f58b-4fac-94f0-ed837b94bf86 service nova] Creating event network-changed:add97173-f389-4e35-b131-c4e58524e3c9 for instance 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d on hv-cinder-85127 Jul 29 05:21:43.724517 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-b0d07096-bebc-4f23-bf6e-684ee0db3c0d req-9eecd0c1-f58b-4fac-94f0-ed837b94bf86 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117821) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 29 05:21:43.750752 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f038ea63-cc38-4892-9fbb-1e923c5f924d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:43.751969 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f038ea63-cc38-4892-9fbb-1e923c5f924d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:43.767988 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f038ea63-cc38-4892-9fbb-1e923c5f924d None None] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:43.770826 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f038ea63-cc38-4892-9fbb-1e923c5f924d None None] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:43.822154 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.compute.rpcapi [None req-f038ea63-cc38-4892-9fbb-1e923c5f924d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 29 05:21:43.823613 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f038ea63-cc38-4892-9fbb-1e923c5f924d None None] Releasing lock "compute-rpcapi-router" {{(pid=117821) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 29 05:21:43.860086 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-f038ea63-cc38-4892-9fbb-1e923c5f924d None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.475394 Jul 29 05:21:43.861414 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 25/47] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:21:43.868201 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-e20d2cde-4dcc-4977-9747-ea3a3f7b2dd3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1592378955", "imageRef": "b7bf870d-4e7c-42fd-849f-72ac19277493", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60b4bb7c-7825-4f15-bc04-5ac3fa10b445"}], "security_groups": [{"name": "tempest-securitygroup--1631972361"}], "key_name": "tempest-keypair-707859948", "user_data": "}} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:21:43.901141 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=7 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:21:44.531570 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.network.neutron [None req-e20d2cde-4dcc-4977-9747-ea3a3f7b2dd3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] validate_networks() for [('60b4bb7c-7825-4f15-bc04-5ac3fa10b445', None, None, None, None, None)] {{(pid=117821) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 05:21:45.183087 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-130a9be9-d58d-4bf9-ab49-997258c0f7bf tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720be309cbe14940873d774b06e91bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87396f5e6bf46f5b85720c8e365da81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:45.190281 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell1:SELECT=69 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:21:45.208629 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-130a9be9-d58d-4bf9-ab49-997258c0f7bf tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] 10.222.0.49 "GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e" status: 200 len: 1314 microversion: 2.1 time: 1.882849 Jul 29 05:21:45.221511 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 23/48] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:43 2022] GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e => generated 1314 bytes in 1896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:45.234439 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-7413c3ef-7f88-4e40-be40-f218da4244d2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2133122556", "imageRef": "b7bf870d-4e7c-42fd-849f-72ac19277493", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2abd58fa-fb8d-4cc3-8df0-c903c7b8dd87"}], "security_groups": [{"name": "tempest-securitygroup--33941384"}], "key_name": "tempest-keypair-491656657", "user_data": "}} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:21:45.255696 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=8 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:21:45.563939 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-e20d2cde-4dcc-4977-9747-ea3a3f7b2dd3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Flavor limits 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 05:21:45.564566 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-e20d2cde-4dcc-4977-9747-ea3a3f7b2dd3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Image limits 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 05:21:45.565406 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-e20d2cde-4dcc-4977-9747-ea3a3f7b2dd3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Flavor pref 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 05:21:45.566330 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-e20d2cde-4dcc-4977-9747-ea3a3f7b2dd3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Image pref 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 05:21:45.567218 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-e20d2cde-4dcc-4977-9747-ea3a3f7b2dd3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 05:21:45.579214 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e20d2cde-4dcc-4977-9747-ea3a3f7b2dd3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:45.580078 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e20d2cde-4dcc-4977-9747-ea3a3f7b2dd3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:45.581489 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e20d2cde-4dcc-4977-9747-ea3a3f7b2dd3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:45.582235 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e20d2cde-4dcc-4977-9747-ea3a3f7b2dd3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:45.606630 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.quota [None req-e20d2cde-4dcc-4977-9747-ea3a3f7b2dd3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Getting quotas for project 92f16adc2357459aa0afb68db89031dd. Resources: {'instances', 'ram', 'cores'} {{(pid=117821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:21:45.611598 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.quota [None req-e20d2cde-4dcc-4977-9747-ea3a3f7b2dd3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Getting quotas for user c2db6ada97da4ee89f3ce8de98f2653a and project 92f16adc2357459aa0afb68db89031dd. Resources: {'instances', 'ram', 'cores'} {{(pid=117821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:21:45.624664 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-e20d2cde-4dcc-4977-9747-ea3a3f7b2dd3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Going to run 1 instances... {{(pid=117821) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 05:21:45.627401 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-e20d2cde-4dcc-4977-9747-ea3a3f7b2dd3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b7bf870d-4e7c-42fd-849f-72ac19277493',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117821) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 05:21:45.697090 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-e20d2cde-4dcc-4977-9747-ea3a3f7b2dd3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.834395 Jul 29 05:21:45.704828 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 26/49] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 05:21:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 1843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 05:21:45.711450 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-add4f685-814a-4416-9103-0c4cfe8f7a04 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:45.712308 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-add4f685-814a-4416-9103-0c4cfe8f7a04 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:45.720867 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-add4f685-814a-4416-9103-0c4cfe8f7a04 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:45.722168 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-add4f685-814a-4416-9103-0c4cfe8f7a04 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:45.723388 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-add4f685-814a-4416-9103-0c4cfe8f7a04 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:45.724056 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-add4f685-814a-4416-9103-0c4cfe8f7a04 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:45.745893 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.network.neutron [None req-7413c3ef-7f88-4e40-be40-f218da4244d2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] validate_networks() for [('2abd58fa-fb8d-4cc3-8df0-c903c7b8dd87', None, None, None, None, None)] {{(pid=117820) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 05:21:45.944313 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-add4f685-814a-4416-9103-0c4cfe8f7a04 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:45.961093 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-add4f685-814a-4416-9103-0c4cfe8f7a04 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780" status: 200 len: 1366 microversion: 2.1 time: 0.251134 Jul 29 05:21:45.962049 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 27/50] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:45 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:45.969037 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-b836ae72-7e85-4c08-b6e6-ce3e40c02f39 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:45.969680 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-b836ae72-7e85-4c08-b6e6-ce3e40c02f39 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:45.977253 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b836ae72-7e85-4c08-b6e6-ce3e40c02f39 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:45.978035 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b836ae72-7e85-4c08-b6e6-ce3e40c02f39 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:45.979004 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b836ae72-7e85-4c08-b6e6-ce3e40c02f39 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:45.979919 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b836ae72-7e85-4c08-b6e6-ce3e40c02f39 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:46.272776 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-b836ae72-7e85-4c08-b6e6-ce3e40c02f39 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:46.282850 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-b836ae72-7e85-4c08-b6e6-ce3e40c02f39 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1321 microversion: 2.1 time: 0.319621 Jul 29 05:21:46.286140 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 28/51] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:45 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1321 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:46.633059 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-1a779ace-aad0-4cee-b9f5-461861b120a4 req-65a9e01e-5fee-456b-b726-9bb68229c116 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51207b24-620a-4479-be28-4db53ef4073e", "tag": "d7a5be9c-7f6e-42cf-b431-44dea7fa4b46"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:21:46.656659 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-1a779ace-aad0-4cee-b9f5-461861b120a4 req-65a9e01e-5fee-456b-b726-9bb68229c116 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:46.658640 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-1a779ace-aad0-4cee-b9f5-461861b120a4 req-65a9e01e-5fee-456b-b726-9bb68229c116 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:46.688482 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-1a779ace-aad0-4cee-b9f5-461861b120a4 req-65a9e01e-5fee-456b-b726-9bb68229c116 service nova] Creating event network-changed:d7a5be9c-7f6e-42cf-b431-44dea7fa4b46 for instance 51207b24-620a-4479-be28-4db53ef4073e on hv-cinder-85127 Jul 29 05:21:46.703472 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-1a779ace-aad0-4cee-b9f5-461861b120a4 req-65a9e01e-5fee-456b-b726-9bb68229c116 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.414124 Jul 29 05:21:46.710887 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 29/52] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:21:46.726526 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-08345f03-fcac-4008-ba55-5439c72adb1c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:46.727492 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-08345f03-fcac-4008-ba55-5439c72adb1c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:46.780144 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-08345f03-fcac-4008-ba55-5439c72adb1c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:46.780953 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-08345f03-fcac-4008-ba55-5439c72adb1c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:46.790160 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-08345f03-fcac-4008-ba55-5439c72adb1c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:46.790879 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-08345f03-fcac-4008-ba55-5439c72adb1c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:46.989455 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-08345f03-fcac-4008-ba55-5439c72adb1c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:47.031976 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-08345f03-fcac-4008-ba55-5439c72adb1c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1233 microversion: 2.1 time: 0.319434 Jul 29 05:21:47.033071 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 30/53] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:46 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1233 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:47.056136 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-44a256f6-4bc0-42f3-81e5-352d5294b358 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:47.059878 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-44a256f6-4bc0-42f3-81e5-352d5294b358 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] [instance: 51207b24-620a-4479-be28-4db53ef4073e] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:47.081115 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-44a256f6-4bc0-42f3-81e5-352d5294b358 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:47.081776 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-44a256f6-4bc0-42f3-81e5-352d5294b358 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:47.083216 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-44a256f6-4bc0-42f3-81e5-352d5294b358 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:47.085381 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-44a256f6-4bc0-42f3-81e5-352d5294b358 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:47.355897 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-7413c3ef-7f88-4e40-be40-f218da4244d2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Flavor limits 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 05:21:47.358262 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-7413c3ef-7f88-4e40-be40-f218da4244d2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Image limits 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 05:21:47.359701 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-7413c3ef-7f88-4e40-be40-f218da4244d2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Flavor pref 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 05:21:47.360151 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-7413c3ef-7f88-4e40-be40-f218da4244d2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Image pref 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 05:21:47.361141 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-7413c3ef-7f88-4e40-be40-f218da4244d2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 05:21:47.374783 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7413c3ef-7f88-4e40-be40-f218da4244d2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:47.375661 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7413c3ef-7f88-4e40-be40-f218da4244d2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:47.376738 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7413c3ef-7f88-4e40-be40-f218da4244d2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:47.377226 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7413c3ef-7f88-4e40-be40-f218da4244d2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:47.387715 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-44a256f6-4bc0-42f3-81e5-352d5294b358 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720be309cbe14940873d774b06e91bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87396f5e6bf46f5b85720c8e365da81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:47.401790 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-44a256f6-4bc0-42f3-81e5-352d5294b358 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] 10.222.0.49 "GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e" status: 200 len: 1314 microversion: 2.1 time: 0.365280 Jul 29 05:21:47.403286 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 31/54] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:47 2022] GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:47.403700 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.quota [None req-7413c3ef-7f88-4e40-be40-f218da4244d2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Getting quotas for project 9fda8c6d9ffa4955b2f19411ee340cb3. Resources: {'instances', 'ram', 'cores'} {{(pid=117820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:21:47.408642 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-4d911858-626f-4f4d-975b-d0be50eb5e7d req-49574ad9-0645-4a36-9d65-36c2aed1c7d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6c67286-4bb1-4dc6-87ba-4c21f3ff863a", "tag": "6bc36d89-d1c5-4873-87c6-12b89c984f37"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:21:47.419998 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.quota [None req-7413c3ef-7f88-4e40-be40-f218da4244d2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Getting quotas for user af5a109a6fb94042aeacbf141d7322ef and project 9fda8c6d9ffa4955b2f19411ee340cb3. Resources: {'instances', 'ram', 'cores'} {{(pid=117820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:21:47.422833 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-4d911858-626f-4f4d-975b-d0be50eb5e7d req-49574ad9-0645-4a36-9d65-36c2aed1c7d5 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:47.423757 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-4d911858-626f-4f4d-975b-d0be50eb5e7d req-49574ad9-0645-4a36-9d65-36c2aed1c7d5 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:47.437882 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-7413c3ef-7f88-4e40-be40-f218da4244d2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Going to run 1 instances... {{(pid=117820) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 05:21:47.439582 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-4d911858-626f-4f4d-975b-d0be50eb5e7d req-49574ad9-0645-4a36-9d65-36c2aed1c7d5 service nova] Creating event network-changed:6bc36d89-d1c5-4873-87c6-12b89c984f37 for instance a6c67286-4bb1-4dc6-87ba-4c21f3ff863a on hv-cinder-85127 Jul 29 05:21:47.441705 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-7413c3ef-7f88-4e40-be40-f218da4244d2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b7bf870d-4e7c-42fd-849f-72ac19277493',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117820) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 05:21:47.445837 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-4d911858-626f-4f4d-975b-d0be50eb5e7d req-49574ad9-0645-4a36-9d65-36c2aed1c7d5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040881 Jul 29 05:21:47.451254 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 32/55] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:21:47.458106 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-7bb078a8-6a3d-4261-a361-4fe50c36f4fb tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:47.459844 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-7bb078a8-6a3d-4261-a361-4fe50c36f4fb tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:47.467586 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7bb078a8-6a3d-4261-a361-4fe50c36f4fb tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:47.468196 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7bb078a8-6a3d-4261-a361-4fe50c36f4fb tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:47.469495 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7bb078a8-6a3d-4261-a361-4fe50c36f4fb tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:47.470115 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7bb078a8-6a3d-4261-a361-4fe50c36f4fb tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:47.516849 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-7413c3ef-7f88-4e40-be40-f218da4244d2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 2.293774 Jul 29 05:21:47.525049 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 24/56] 10.222.0.49 () {62 vars in 1188 bytes} [Fri Jul 29 05:21:45 2022] POST /compute/v2.1/servers => generated 400 bytes in 2303 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 29 05:21:47.531967 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-d8ccb80f-2837-4298-a2b9-e190d00764eb tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:47.533147 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-d8ccb80f-2837-4298-a2b9-e190d00764eb tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:47.542429 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d8ccb80f-2837-4298-a2b9-e190d00764eb tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:47.543141 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d8ccb80f-2837-4298-a2b9-e190d00764eb tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:47.544245 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d8ccb80f-2837-4298-a2b9-e190d00764eb tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:47.544827 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d8ccb80f-2837-4298-a2b9-e190d00764eb tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:47.712437 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-7bb078a8-6a3d-4261-a361-4fe50c36f4fb tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:47.727573 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-7bb078a8-6a3d-4261-a361-4fe50c36f4fb tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780" status: 200 len: 1366 microversion: 2.1 time: 0.274783 Jul 29 05:21:47.743825 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 33/57] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:47 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 => generated 1366 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:47.749295 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-b7de2a34-f6ad-4ce5-a444-8e948ad785c1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:47.750180 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-b7de2a34-f6ad-4ce5-a444-8e948ad785c1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:47.794311 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-d8ccb80f-2837-4298-a2b9-e190d00764eb tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:47.806022 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-d8ccb80f-2837-4298-a2b9-e190d00764eb tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1321 microversion: 2.1 time: 0.279597 Jul 29 05:21:47.809203 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 25/58] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:47 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:47.842940 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-b7de2a34-f6ad-4ce5-a444-8e948ad785c1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:47.858438 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-b7de2a34-f6ad-4ce5-a444-8e948ad785c1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:47.860605 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-b7de2a34-f6ad-4ce5-a444-8e948ad785c1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:47.861710 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-b7de2a34-f6ad-4ce5-a444-8e948ad785c1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1281 microversion: 2.20 time: 0.116598 Jul 29 05:21:47.863078 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 34/59] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:21:47 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1281 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:21:48.057084 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-ac6fb233-d9c9-4fd1-9257-efff6d20a8b5 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:48.058130 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-ac6fb233-d9c9-4fd1-9257-efff6d20a8b5 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:48.079015 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ac6fb233-d9c9-4fd1-9257-efff6d20a8b5 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:48.081825 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ac6fb233-d9c9-4fd1-9257-efff6d20a8b5 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:48.085290 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ac6fb233-d9c9-4fd1-9257-efff6d20a8b5 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:48.090564 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ac6fb233-d9c9-4fd1-9257-efff6d20a8b5 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:48.435483 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-9a547c06-8e4c-4854-8326-0482fa6d16e6 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:48.438560 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-9a547c06-8e4c-4854-8326-0482fa6d16e6 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] [instance: 51207b24-620a-4479-be28-4db53ef4073e] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:48.454859 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9a547c06-8e4c-4854-8326-0482fa6d16e6 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:48.457262 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9a547c06-8e4c-4854-8326-0482fa6d16e6 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:48.463124 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9a547c06-8e4c-4854-8326-0482fa6d16e6 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:48.464775 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9a547c06-8e4c-4854-8326-0482fa6d16e6 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:48.466819 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-ac6fb233-d9c9-4fd1-9257-efff6d20a8b5 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:48.479572 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-ac6fb233-d9c9-4fd1-9257-efff6d20a8b5 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1289 microversion: 2.1 time: 0.426168 Jul 29 05:21:48.481959 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 26/60] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:48 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1289 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:48.713811 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-9a547c06-8e4c-4854-8326-0482fa6d16e6 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720be309cbe14940873d774b06e91bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87396f5e6bf46f5b85720c8e365da81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:48.733221 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-9a547c06-8e4c-4854-8326-0482fa6d16e6 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] 10.222.0.49 "GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e" status: 200 len: 1314 microversion: 2.1 time: 0.310489 Jul 29 05:21:48.744009 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 35/61] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:48 2022] GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:21:48.758978 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-9fe89317-eba0-45c5-8f1b-233854379b9d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:48.760583 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-9fe89317-eba0-45c5-8f1b-233854379b9d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:48.775119 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9fe89317-eba0-45c5-8f1b-233854379b9d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:48.777257 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9fe89317-eba0-45c5-8f1b-233854379b9d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:48.779631 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9fe89317-eba0-45c5-8f1b-233854379b9d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:48.783511 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9fe89317-eba0-45c5-8f1b-233854379b9d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:48.833363 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-28ae3848-37c3-4136-b414-83acccd19ef0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:48.834123 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-28ae3848-37c3-4136-b414-83acccd19ef0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:48.841821 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-28ae3848-37c3-4136-b414-83acccd19ef0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:48.842284 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-28ae3848-37c3-4136-b414-83acccd19ef0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:48.843065 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-28ae3848-37c3-4136-b414-83acccd19ef0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:48.843538 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-28ae3848-37c3-4136-b414-83acccd19ef0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:48.869007 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell1:SELECT=100 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:21:49.010620 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-9fe89317-eba0-45c5-8f1b-233854379b9d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:49.026688 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-9fe89317-eba0-45c5-8f1b-233854379b9d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780" status: 200 len: 1366 microversion: 2.1 time: 0.279782 Jul 29 05:21:49.030860 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 27/62] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:48 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 => generated 1366 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:49.049104 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-c7f42d4d-2a0b-4264-baa8-2bdb0aeabd57 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:49.050031 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-c7f42d4d-2a0b-4264-baa8-2bdb0aeabd57 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:49.073465 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c7f42d4d-2a0b-4264-baa8-2bdb0aeabd57 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:49.074967 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c7f42d4d-2a0b-4264-baa8-2bdb0aeabd57 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:49.078712 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c7f42d4d-2a0b-4264-baa8-2bdb0aeabd57 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:49.079927 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c7f42d4d-2a0b-4264-baa8-2bdb0aeabd57 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:49.449783 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-c7f42d4d-2a0b-4264-baa8-2bdb0aeabd57 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:49.459244 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-c7f42d4d-2a0b-4264-baa8-2bdb0aeabd57 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:49.469941 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-c7f42d4d-2a0b-4264-baa8-2bdb0aeabd57 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:49.471130 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-c7f42d4d-2a0b-4264-baa8-2bdb0aeabd57 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1285 microversion: 2.20 time: 0.439013 Jul 29 05:21:49.471777 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 28/63] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:21:49 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1285 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:21:49.500520 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-28ae3848-37c3-4136-b414-83acccd19ef0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:49.501978 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-9472917f-f69f-45e3-89b6-99e58b4e94d6 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:49.502821 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-9472917f-f69f-45e3-89b6-99e58b4e94d6 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:49.509405 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-28ae3848-37c3-4136-b414-83acccd19ef0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1321 microversion: 2.1 time: 0.682121 Jul 29 05:21:49.511334 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9472917f-f69f-45e3-89b6-99e58b4e94d6 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:49.523404 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 36/64] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:48 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1321 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:49.524484 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9472917f-f69f-45e3-89b6-99e58b4e94d6 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:49.525323 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9472917f-f69f-45e3-89b6-99e58b4e94d6 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:49.525762 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9472917f-f69f-45e3-89b6-99e58b4e94d6 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:49.762677 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-8ab30599-a1c7-48f9-823d-20a2b0df9083 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:49.764750 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-8ab30599-a1c7-48f9-823d-20a2b0df9083 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] [instance: 51207b24-620a-4479-be28-4db53ef4073e] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:49.785676 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8ab30599-a1c7-48f9-823d-20a2b0df9083 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:49.800965 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8ab30599-a1c7-48f9-823d-20a2b0df9083 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:49.802996 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8ab30599-a1c7-48f9-823d-20a2b0df9083 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:49.804122 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8ab30599-a1c7-48f9-823d-20a2b0df9083 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:50.356795 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-8ab30599-a1c7-48f9-823d-20a2b0df9083 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720be309cbe14940873d774b06e91bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87396f5e6bf46f5b85720c8e365da81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:50.376209 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-8ab30599-a1c7-48f9-823d-20a2b0df9083 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] 10.222.0.49 "GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e" status: 200 len: 1314 microversion: 2.1 time: 0.620073 Jul 29 05:21:50.376840 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 37/65] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:49 2022] GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e => generated 1314 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:50.410091 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-5c6bac26-dd78-44c1-961a-b343e3f37862 req-212b0594-9e9c-400b-bff5-7de156774288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05c46947-e368-441d-9e07-584e95d55780", "tag": "a271d975-09dc-4c3e-8b57-3468787c62a8"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:21:50.433085 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-5c6bac26-dd78-44c1-961a-b343e3f37862 req-212b0594-9e9c-400b-bff5-7de156774288 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:50.441169 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-5c6bac26-dd78-44c1-961a-b343e3f37862 req-212b0594-9e9c-400b-bff5-7de156774288 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:50.457789 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-5c6bac26-dd78-44c1-961a-b343e3f37862 req-212b0594-9e9c-400b-bff5-7de156774288 service nova] Creating event network-changed:a271d975-09dc-4c3e-8b57-3468787c62a8 for instance 05c46947-e368-441d-9e07-584e95d55780 on hv-cinder-85127 Jul 29 05:21:50.463530 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-5c6bac26-dd78-44c1-961a-b343e3f37862 req-212b0594-9e9c-400b-bff5-7de156774288 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068765 Jul 29 05:21:50.464722 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 38/66] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:21:50.471073 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-3330d7c9-5277-4f77-8ff0-0c30da2828ff tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:50.472660 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-3330d7c9-5277-4f77-8ff0-0c30da2828ff tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:50.482108 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3330d7c9-5277-4f77-8ff0-0c30da2828ff tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:50.482784 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3330d7c9-5277-4f77-8ff0-0c30da2828ff tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:50.484243 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3330d7c9-5277-4f77-8ff0-0c30da2828ff tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:50.485176 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3330d7c9-5277-4f77-8ff0-0c30da2828ff tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:50.486466 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-9472917f-f69f-45e3-89b6-99e58b4e94d6 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:50.498899 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-9472917f-f69f-45e3-89b6-99e58b4e94d6 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1295 microversion: 2.1 time: 1.000907 Jul 29 05:21:50.501829 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 29/67] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:49 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1295 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:21:50.506769 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-9b2dcb6b-234d-45fe-b2ff-9666a32d5dfc tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:50.528180 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-9b2dcb6b-234d-45fe-b2ff-9666a32d5dfc tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:50.547688 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9b2dcb6b-234d-45fe-b2ff-9666a32d5dfc tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:50.548307 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9b2dcb6b-234d-45fe-b2ff-9666a32d5dfc tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:50.549239 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9b2dcb6b-234d-45fe-b2ff-9666a32d5dfc tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:50.550228 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9b2dcb6b-234d-45fe-b2ff-9666a32d5dfc tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:50.880587 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-9b2dcb6b-234d-45fe-b2ff-9666a32d5dfc tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:50.889546 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-9b2dcb6b-234d-45fe-b2ff-9666a32d5dfc tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:50.891131 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-9b2dcb6b-234d-45fe-b2ff-9666a32d5dfc tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:50.892286 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-9b2dcb6b-234d-45fe-b2ff-9666a32d5dfc tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1339 microversion: 2.20 time: 0.389309 Jul 29 05:21:50.892853 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 30/68] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:21:50 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1339 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:21:50.902462 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-3330d7c9-5277-4f77-8ff0-0c30da2828ff tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:50.927947 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-df954020-b742-4457-9785-faf83477992e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:50.929106 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-df954020-b742-4457-9785-faf83477992e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:50.949307 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-df954020-b742-4457-9785-faf83477992e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:50.956824 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-df954020-b742-4457-9785-faf83477992e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:50.956977 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-3330d7c9-5277-4f77-8ff0-0c30da2828ff tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780" status: 200 len: 1366 microversion: 2.1 time: 0.460234 Jul 29 05:21:50.957058 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-df954020-b742-4457-9785-faf83477992e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:50.957131 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 39/69] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:50 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 => generated 1366 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:50.957243 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-df954020-b742-4457-9785-faf83477992e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:51.402088 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-f84b8c47-09d1-463c-bbde-03bee035023b tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:51.403926 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-f84b8c47-09d1-463c-bbde-03bee035023b tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] [instance: 51207b24-620a-4479-be28-4db53ef4073e] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:51.413276 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f84b8c47-09d1-463c-bbde-03bee035023b tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:51.414153 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f84b8c47-09d1-463c-bbde-03bee035023b tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:51.415078 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f84b8c47-09d1-463c-bbde-03bee035023b tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:51.415947 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f84b8c47-09d1-463c-bbde-03bee035023b tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:51.881865 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-f84b8c47-09d1-463c-bbde-03bee035023b tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720be309cbe14940873d774b06e91bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87396f5e6bf46f5b85720c8e365da81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:51.889746 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-f84b8c47-09d1-463c-bbde-03bee035023b tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] 10.222.0.49 "GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e" status: 200 len: 1314 microversion: 2.1 time: 0.491497 Jul 29 05:21:51.890339 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 40/70] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:51 2022] GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:21:51.916250 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-2b26fb6b-ed4a-489f-bac0-b1b46b676c4c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:51.918420 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-2b26fb6b-ed4a-489f-bac0-b1b46b676c4c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:51.935274 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2b26fb6b-ed4a-489f-bac0-b1b46b676c4c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:51.936333 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2b26fb6b-ed4a-489f-bac0-b1b46b676c4c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:51.937558 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2b26fb6b-ed4a-489f-bac0-b1b46b676c4c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:51.939024 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2b26fb6b-ed4a-489f-bac0-b1b46b676c4c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:52.068708 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-2b26fb6b-ed4a-489f-bac0-b1b46b676c4c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:52.080327 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-2b26fb6b-ed4a-489f-bac0-b1b46b676c4c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1295 microversion: 2.1 time: 0.171939 Jul 29 05:21:52.081790 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 41/71] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:51 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1295 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:52.103583 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-8cc25f11-c28b-4bc9-865f-433fc586ca8f tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:52.104199 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-8cc25f11-c28b-4bc9-865f-433fc586ca8f tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:52.107386 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-df954020-b742-4457-9785-faf83477992e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:52.122491 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-df954020-b742-4457-9785-faf83477992e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1321 microversion: 2.1 time: 1.218227 Jul 29 05:21:52.122961 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8cc25f11-c28b-4bc9-865f-433fc586ca8f tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:52.123247 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 31/72] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:50 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1321 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:52.136459 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8cc25f11-c28b-4bc9-865f-433fc586ca8f tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:52.137309 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8cc25f11-c28b-4bc9-865f-433fc586ca8f tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:52.137757 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8cc25f11-c28b-4bc9-865f-433fc586ca8f tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:52.149336 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-0c4ffe06-3f3c-4234-8f5c-6056c0ca06f0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:52.202038 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-0c4ffe06-3f3c-4234-8f5c-6056c0ca06f0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:52.243339 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0c4ffe06-3f3c-4234-8f5c-6056c0ca06f0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:52.255602 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0c4ffe06-3f3c-4234-8f5c-6056c0ca06f0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:52.258775 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0c4ffe06-3f3c-4234-8f5c-6056c0ca06f0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:52.259400 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0c4ffe06-3f3c-4234-8f5c-6056c0ca06f0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:52.333682 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-8cc25f11-c28b-4bc9-865f-433fc586ca8f tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:52.343159 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-8cc25f11-c28b-4bc9-865f-433fc586ca8f tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:52.344951 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-8cc25f11-c28b-4bc9-865f-433fc586ca8f tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:52.346882 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-8cc25f11-c28b-4bc9-865f-433fc586ca8f tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1339 microversion: 2.20 time: 0.263089 Jul 29 05:21:52.348008 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 42/73] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:21:52 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1339 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:21:52.655812 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-0c4ffe06-3f3c-4234-8f5c-6056c0ca06f0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:52.674166 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-0c4ffe06-3f3c-4234-8f5c-6056c0ca06f0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780" status: 200 len: 1366 microversion: 2.1 time: 0.549678 Jul 29 05:21:52.676154 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 32/74] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:52 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 => generated 1366 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:52.921323 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-41d4725a-960d-457b-ba9f-372a2fb953dd tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:52.922859 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-41d4725a-960d-457b-ba9f-372a2fb953dd tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] [instance: 51207b24-620a-4479-be28-4db53ef4073e] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:52.945828 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-41d4725a-960d-457b-ba9f-372a2fb953dd tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:52.947539 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-41d4725a-960d-457b-ba9f-372a2fb953dd tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:52.948432 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-41d4725a-960d-457b-ba9f-372a2fb953dd tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:52.948891 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-41d4725a-960d-457b-ba9f-372a2fb953dd tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:53.104250 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-3fae4ffb-b2c5-4a5d-998d-a171e8499cc7 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:53.104864 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-3fae4ffb-b2c5-4a5d-998d-a171e8499cc7 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:53.115519 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3fae4ffb-b2c5-4a5d-998d-a171e8499cc7 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:53.116200 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3fae4ffb-b2c5-4a5d-998d-a171e8499cc7 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:53.116737 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3fae4ffb-b2c5-4a5d-998d-a171e8499cc7 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:53.117172 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3fae4ffb-b2c5-4a5d-998d-a171e8499cc7 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:53.297457 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-41d4725a-960d-457b-ba9f-372a2fb953dd tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720be309cbe14940873d774b06e91bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87396f5e6bf46f5b85720c8e365da81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:53.307011 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-41d4725a-960d-457b-ba9f-372a2fb953dd tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] 10.222.0.49 "GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e" status: 200 len: 1314 microversion: 2.1 time: 0.393869 Jul 29 05:21:53.308029 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 43/75] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:52 2022] GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:53.314119 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-017b9187-4333-4e21-b558-eb4ae3a9de3d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:53.315809 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-017b9187-4333-4e21-b558-eb4ae3a9de3d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:53.324203 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-017b9187-4333-4e21-b558-eb4ae3a9de3d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:53.324867 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-017b9187-4333-4e21-b558-eb4ae3a9de3d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:53.326554 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-017b9187-4333-4e21-b558-eb4ae3a9de3d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:53.327222 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-017b9187-4333-4e21-b558-eb4ae3a9de3d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:53.510192 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-017b9187-4333-4e21-b558-eb4ae3a9de3d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:53.524192 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-017b9187-4333-4e21-b558-eb4ae3a9de3d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1321 microversion: 2.1 time: 0.212465 Jul 29 05:21:53.536650 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 44/76] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:53 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:53.663148 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-8efea83c-f55e-42de-bf60-76b121859cd6 req-4a31a8e6-7905-4d63-ba16-3615d8a94e3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6c67286-4bb1-4dc6-87ba-4c21f3ff863a", "name": "network-vif-plugged", "status": "completed", "tag": "6bc36d89-d1c5-4873-87c6-12b89c984f37"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:21:53.686816 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-8efea83c-f55e-42de-bf60-76b121859cd6 req-4a31a8e6-7905-4d63-ba16-3615d8a94e3b service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:53.688387 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-8efea83c-f55e-42de-bf60-76b121859cd6 req-4a31a8e6-7905-4d63-ba16-3615d8a94e3b service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:53.726704 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-8efea83c-f55e-42de-bf60-76b121859cd6 req-4a31a8e6-7905-4d63-ba16-3615d8a94e3b service nova] Creating event network-vif-plugged:6bc36d89-d1c5-4873-87c6-12b89c984f37 for instance a6c67286-4bb1-4dc6-87ba-4c21f3ff863a on hv-cinder-85127 Jul 29 05:21:53.741848 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-8efea83c-f55e-42de-bf60-76b121859cd6 req-4a31a8e6-7905-4d63-ba16-3615d8a94e3b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203412 Jul 29 05:21:53.758425 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 45/77] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:21:53.778232 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-16c1039b-d845-4bdb-92fb-f6207767a684 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:53.778938 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-16c1039b-d845-4bdb-92fb-f6207767a684 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:53.797572 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-16c1039b-d845-4bdb-92fb-f6207767a684 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:53.798028 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-16c1039b-d845-4bdb-92fb-f6207767a684 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:53.800356 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-16c1039b-d845-4bdb-92fb-f6207767a684 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:53.800756 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-16c1039b-d845-4bdb-92fb-f6207767a684 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:53.985013 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-3fae4ffb-b2c5-4a5d-998d-a171e8499cc7 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:53.997317 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-3fae4ffb-b2c5-4a5d-998d-a171e8499cc7 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1363 microversion: 2.1 time: 0.897530 Jul 29 05:21:54.000331 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 33/78] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:53 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1363 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:54.016586 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-540401ad-be0c-4d69-954f-9e10341e4296 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:54.019863 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-540401ad-be0c-4d69-954f-9e10341e4296 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:54.041946 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-540401ad-be0c-4d69-954f-9e10341e4296 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:54.044343 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-540401ad-be0c-4d69-954f-9e10341e4296 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:54.045271 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-540401ad-be0c-4d69-954f-9e10341e4296 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:54.046997 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-540401ad-be0c-4d69-954f-9e10341e4296 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:54.120735 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-16c1039b-d845-4bdb-92fb-f6207767a684 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:54.134891 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-16c1039b-d845-4bdb-92fb-f6207767a684 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:54.137378 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-16c1039b-d845-4bdb-92fb-f6207767a684 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:54.141480 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-16c1039b-d845-4bdb-92fb-f6207767a684 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1405 microversion: 2.20 time: 0.378277 Jul 29 05:21:54.144231 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 46/79] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:21:53 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1405 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:21:54.330279 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-ad82a8a9-1d9e-4362-8f57-9310c6d5d958 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:54.331566 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-ad82a8a9-1d9e-4362-8f57-9310c6d5d958 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] [instance: 51207b24-620a-4479-be28-4db53ef4073e] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:54.352955 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ad82a8a9-1d9e-4362-8f57-9310c6d5d958 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:54.353608 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ad82a8a9-1d9e-4362-8f57-9310c6d5d958 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:54.354582 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ad82a8a9-1d9e-4362-8f57-9310c6d5d958 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:54.355028 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ad82a8a9-1d9e-4362-8f57-9310c6d5d958 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:54.601565 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-ad82a8a9-1d9e-4362-8f57-9310c6d5d958 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720be309cbe14940873d774b06e91bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87396f5e6bf46f5b85720c8e365da81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:54.617943 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-ad82a8a9-1d9e-4362-8f57-9310c6d5d958 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] 10.222.0.49 "GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e" status: 200 len: 1314 microversion: 2.1 time: 0.292205 Jul 29 05:21:54.624882 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 47/80] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:54 2022] GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:54.637805 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-a5c7503d-9677-4f0a-a84c-c28f995c7550 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:54.638425 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-a5c7503d-9677-4f0a-a84c-c28f995c7550 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:54.644689 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a5c7503d-9677-4f0a-a84c-c28f995c7550 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:54.645248 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a5c7503d-9677-4f0a-a84c-c28f995c7550 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:54.646014 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a5c7503d-9677-4f0a-a84c-c28f995c7550 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:54.646756 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a5c7503d-9677-4f0a-a84c-c28f995c7550 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:54.688524 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-540401ad-be0c-4d69-954f-9e10341e4296 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:54.700214 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-540401ad-be0c-4d69-954f-9e10341e4296 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780" status: 200 len: 1366 microversion: 2.1 time: 0.698534 Jul 29 05:21:54.701887 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 34/81] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:54 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 => generated 1366 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:54.864709 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-a5c7503d-9677-4f0a-a84c-c28f995c7550 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:54.875887 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-a5c7503d-9677-4f0a-a84c-c28f995c7550 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1321 microversion: 2.1 time: 0.248040 Jul 29 05:21:54.876488 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 48/82] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:54 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:55.026374 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-7d96e347-527a-4f50-8bc2-10f1ea009ea8 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:55.027165 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-7d96e347-527a-4f50-8bc2-10f1ea009ea8 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:55.037509 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7d96e347-527a-4f50-8bc2-10f1ea009ea8 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:55.038597 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7d96e347-527a-4f50-8bc2-10f1ea009ea8 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:55.039664 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7d96e347-527a-4f50-8bc2-10f1ea009ea8 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:55.040318 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7d96e347-527a-4f50-8bc2-10f1ea009ea8 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:55.176547 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-36ac0355-b0fa-4e35-af50-fc79ccf0d27c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:55.178631 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-36ac0355-b0fa-4e35-af50-fc79ccf0d27c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:55.189389 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-36ac0355-b0fa-4e35-af50-fc79ccf0d27c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:55.190307 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-36ac0355-b0fa-4e35-af50-fc79ccf0d27c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:55.191109 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-36ac0355-b0fa-4e35-af50-fc79ccf0d27c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:55.192394 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-36ac0355-b0fa-4e35-af50-fc79ccf0d27c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:55.285747 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-7d96e347-527a-4f50-8bc2-10f1ea009ea8 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:55.295677 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-7d96e347-527a-4f50-8bc2-10f1ea009ea8 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1363 microversion: 2.1 time: 0.275218 Jul 29 05:21:55.311447 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 35/83] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:55 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1363 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:55.370319 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-c30aec87-7271-4f1e-8a11-f253a4b19928 req-3650bdd2-9693-438c-9453-b494c17713fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6ff83e9-b98e-47c5-83cb-37ac61826fba", "tag": "271bc52d-2fba-4db9-bfaa-44a4a119f24e"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:21:55.406561 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-c30aec87-7271-4f1e-8a11-f253a4b19928 req-3650bdd2-9693-438c-9453-b494c17713fe service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:55.408996 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-c30aec87-7271-4f1e-8a11-f253a4b19928 req-3650bdd2-9693-438c-9453-b494c17713fe service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:55.415410 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-36ac0355-b0fa-4e35-af50-fc79ccf0d27c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:55.427266 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-36ac0355-b0fa-4e35-af50-fc79ccf0d27c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:55.431334 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-36ac0355-b0fa-4e35-af50-fc79ccf0d27c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:55.432585 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-36ac0355-b0fa-4e35-af50-fc79ccf0d27c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1405 microversion: 2.20 time: 0.265456 Jul 29 05:21:55.438600 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 49/84] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:21:55 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1405 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:21:55.466128 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-c30aec87-7271-4f1e-8a11-f253a4b19928 req-3650bdd2-9693-438c-9453-b494c17713fe service nova] Creating event network-changed:271bc52d-2fba-4db9-bfaa-44a4a119f24e for instance f6ff83e9-b98e-47c5-83cb-37ac61826fba on hv-cinder-85127 Jul 29 05:21:55.466682 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-c30aec87-7271-4f1e-8a11-f253a4b19928 req-3650bdd2-9693-438c-9453-b494c17713fe service nova] Acquired lock "compute-rpcapi-router" {{(pid=117820) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 29 05:21:55.468894 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9d12d23c-7fc1-4373-96ff-9d4028d0bf47 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:55.469868 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9d12d23c-7fc1-4373-96ff-9d4028d0bf47 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:55.471932 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9d12d23c-7fc1-4373-96ff-9d4028d0bf47 None None] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:55.472544 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9d12d23c-7fc1-4373-96ff-9d4028d0bf47 None None] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:55.487990 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.compute.rpcapi [None req-9d12d23c-7fc1-4373-96ff-9d4028d0bf47 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 29 05:21:55.489573 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9d12d23c-7fc1-4373-96ff-9d4028d0bf47 None None] Releasing lock "compute-rpcapi-router" {{(pid=117820) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 29 05:21:55.509456 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-9d12d23c-7fc1-4373-96ff-9d4028d0bf47 None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143068 Jul 29 05:21:55.513313 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 36/85] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:21:55.640485 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-7a4cad16-eb94-49b9-9205-6049f880deaa tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:55.641928 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-7a4cad16-eb94-49b9-9205-6049f880deaa tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] [instance: 51207b24-620a-4479-be28-4db53ef4073e] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:55.644044 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell0:SELECT=4 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:21:55.656074 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7a4cad16-eb94-49b9-9205-6049f880deaa tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:55.657375 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7a4cad16-eb94-49b9-9205-6049f880deaa tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:55.658760 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7a4cad16-eb94-49b9-9205-6049f880deaa tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:55.659907 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7a4cad16-eb94-49b9-9205-6049f880deaa tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:55.723814 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-d5c1e07d-fea9-4a6e-8825-dbae571d5f9a tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:55.725327 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-d5c1e07d-fea9-4a6e-8825-dbae571d5f9a tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:55.732826 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d5c1e07d-fea9-4a6e-8825-dbae571d5f9a tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:55.733555 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d5c1e07d-fea9-4a6e-8825-dbae571d5f9a tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:55.734655 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d5c1e07d-fea9-4a6e-8825-dbae571d5f9a tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:55.735279 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d5c1e07d-fea9-4a6e-8825-dbae571d5f9a tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:55.852422 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-7a4cad16-eb94-49b9-9205-6049f880deaa tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720be309cbe14940873d774b06e91bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87396f5e6bf46f5b85720c8e365da81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:55.862329 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-7a4cad16-eb94-49b9-9205-6049f880deaa tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] 10.222.0.49 "GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e" status: 200 len: 1314 microversion: 2.1 time: 0.225258 Jul 29 05:21:55.863488 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 50/86] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:55 2022] GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:55.869722 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-27e4d4cb-cb80-44ac-ad21-c5ab2dbfa9ee req-1621cba0-3104-409c-b23b-98beff124702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f080dde-4e70-4d3f-aa8c-ced0a1065d3d", "name": "network-vif-plugged", "status": "completed", "tag": "add97173-f389-4e35-b131-c4e58524e3c9"}, {"server_uuid": "51207b24-620a-4479-be28-4db53ef4073e", "name": "network-vif-plugged", "status": "completed", "tag": "d7a5be9c-7f6e-42cf-b431-44dea7fa4b46"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:21:55.885227 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-27e4d4cb-cb80-44ac-ad21-c5ab2dbfa9ee req-1621cba0-3104-409c-b23b-98beff124702 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:55.885654 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-27e4d4cb-cb80-44ac-ad21-c5ab2dbfa9ee req-1621cba0-3104-409c-b23b-98beff124702 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:55.906606 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-27e4d4cb-cb80-44ac-ad21-c5ab2dbfa9ee req-1621cba0-3104-409c-b23b-98beff124702 service nova] Creating event network-vif-plugged:add97173-f389-4e35-b131-c4e58524e3c9 for instance 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d on hv-cinder-85127 Jul 29 05:21:55.907108 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-27e4d4cb-cb80-44ac-ad21-c5ab2dbfa9ee req-1621cba0-3104-409c-b23b-98beff124702 service nova] Creating event network-vif-plugged:d7a5be9c-7f6e-42cf-b431-44dea7fa4b46 for instance 51207b24-620a-4479-be28-4db53ef4073e on hv-cinder-85127 Jul 29 05:21:55.914872 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-27e4d4cb-cb80-44ac-ad21-c5ab2dbfa9ee req-1621cba0-3104-409c-b23b-98beff124702 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049992 Jul 29 05:21:55.916075 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 51/87] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:21:55.921140 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-5d088dc0-b2b8-4e32-a40f-30818e406967 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:55.921832 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-5d088dc0-b2b8-4e32-a40f-30818e406967 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:55.929223 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5d088dc0-b2b8-4e32-a40f-30818e406967 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:55.929891 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5d088dc0-b2b8-4e32-a40f-30818e406967 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:55.930970 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5d088dc0-b2b8-4e32-a40f-30818e406967 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:55.931791 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5d088dc0-b2b8-4e32-a40f-30818e406967 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:56.007309 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-d5c1e07d-fea9-4a6e-8825-dbae571d5f9a tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:56.029512 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-d5c1e07d-fea9-4a6e-8825-dbae571d5f9a tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780" status: 200 len: 1366 microversion: 2.1 time: 0.310623 Jul 29 05:21:56.031704 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 37/88] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:55 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 => generated 1366 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:21:56.095820 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-5d088dc0-b2b8-4e32-a40f-30818e406967 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:56.106144 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-5d088dc0-b2b8-4e32-a40f-30818e406967 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1321 microversion: 2.1 time: 0.188788 Jul 29 05:21:56.106659 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 52/89] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:55 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:56.320504 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-cdd8d02a-183b-4e9b-8e85-0782967abe94 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:56.321169 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-cdd8d02a-183b-4e9b-8e85-0782967abe94 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:56.327198 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-cdd8d02a-183b-4e9b-8e85-0782967abe94 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:56.327884 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-cdd8d02a-183b-4e9b-8e85-0782967abe94 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:56.328684 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-cdd8d02a-183b-4e9b-8e85-0782967abe94 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:56.329114 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-cdd8d02a-183b-4e9b-8e85-0782967abe94 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:56.464611 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-5e88eb29-4422-417f-b894-7d6a43739cbe tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:56.467695 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-5e88eb29-4422-417f-b894-7d6a43739cbe tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:56.477304 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5e88eb29-4422-417f-b894-7d6a43739cbe tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:56.478102 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5e88eb29-4422-417f-b894-7d6a43739cbe tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:56.479705 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5e88eb29-4422-417f-b894-7d6a43739cbe tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:56.481019 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5e88eb29-4422-417f-b894-7d6a43739cbe tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:56.486422 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-cdd8d02a-183b-4e9b-8e85-0782967abe94 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:56.496229 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-cdd8d02a-183b-4e9b-8e85-0782967abe94 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1363 microversion: 2.1 time: 0.179383 Jul 29 05:21:56.496815 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 38/90] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:56 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:56.636006 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-5e88eb29-4422-417f-b894-7d6a43739cbe tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:56.645604 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-5e88eb29-4422-417f-b894-7d6a43739cbe tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:56.647670 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-5e88eb29-4422-417f-b894-7d6a43739cbe tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:56.648801 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-5e88eb29-4422-417f-b894-7d6a43739cbe tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1405 microversion: 2.20 time: 0.191760 Jul 29 05:21:56.649383 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 53/91] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:21:56 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1405 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:21:56.885006 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-eb3758dc-54b2-4d5f-a446-d83074cd3f0e tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:56.885520 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-eb3758dc-54b2-4d5f-a446-d83074cd3f0e tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] [instance: 51207b24-620a-4479-be28-4db53ef4073e] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:56.891992 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-eb3758dc-54b2-4d5f-a446-d83074cd3f0e tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:56.892431 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-eb3758dc-54b2-4d5f-a446-d83074cd3f0e tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:56.893399 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-eb3758dc-54b2-4d5f-a446-d83074cd3f0e tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:56.893829 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-eb3758dc-54b2-4d5f-a446-d83074cd3f0e tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:57.051884 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-308fc679-7371-4f17-b3df-f72cc9fb1c64 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:57.052856 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-308fc679-7371-4f17-b3df-f72cc9fb1c64 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:57.059753 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-308fc679-7371-4f17-b3df-f72cc9fb1c64 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:57.060951 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-308fc679-7371-4f17-b3df-f72cc9fb1c64 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:57.064326 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-308fc679-7371-4f17-b3df-f72cc9fb1c64 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:57.067189 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-308fc679-7371-4f17-b3df-f72cc9fb1c64 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:57.280602 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-308fc679-7371-4f17-b3df-f72cc9fb1c64 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:57.289987 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell1:SELECT=100 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:21:57.294678 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-308fc679-7371-4f17-b3df-f72cc9fb1c64 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780" status: 200 len: 1366 microversion: 2.1 time: 0.247102 Jul 29 05:21:57.296303 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 54/92] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:57 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:57.304803 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-aa18623d-f3a0-4966-a169-f3cbdc9a898c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:57.305685 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-aa18623d-f3a0-4966-a169-f3cbdc9a898c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:57.314008 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-aa18623d-f3a0-4966-a169-f3cbdc9a898c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:57.314836 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-aa18623d-f3a0-4966-a169-f3cbdc9a898c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:57.315964 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-aa18623d-f3a0-4966-a169-f3cbdc9a898c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:57.316683 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-aa18623d-f3a0-4966-a169-f3cbdc9a898c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:57.430063 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell0:SELECT=6 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:21:57.438293 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-eb3758dc-54b2-4d5f-a446-d83074cd3f0e tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720be309cbe14940873d774b06e91bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87396f5e6bf46f5b85720c8e365da81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:57.458621 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-eb3758dc-54b2-4d5f-a446-d83074cd3f0e tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] 10.222.0.49 "GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e" status: 200 len: 1314 microversion: 2.1 time: 0.573453 Jul 29 05:21:57.458621 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 39/93] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:56 2022] GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e => generated 1314 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:57.520862 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-34abc0c6-0851-4663-b71e-97685c30f8b5 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:57.522274 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-34abc0c6-0851-4663-b71e-97685c30f8b5 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:57.535461 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-34abc0c6-0851-4663-b71e-97685c30f8b5 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:57.535954 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-34abc0c6-0851-4663-b71e-97685c30f8b5 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:57.541145 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-34abc0c6-0851-4663-b71e-97685c30f8b5 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:57.542411 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-34abc0c6-0851-4663-b71e-97685c30f8b5 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:57.670098 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-aa18623d-f3a0-4966-a169-f3cbdc9a898c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:57.684995 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-aa18623d-f3a0-4966-a169-f3cbdc9a898c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1321 microversion: 2.1 time: 0.387015 Jul 29 05:21:57.686622 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 55/94] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:57 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1321 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:57.701147 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-ff648ca7-5e7d-4d51-b499-0aa5558ad39a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:57.701823 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-ff648ca7-5e7d-4d51-b499-0aa5558ad39a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:57.717444 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ff648ca7-5e7d-4d51-b499-0aa5558ad39a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:57.717900 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ff648ca7-5e7d-4d51-b499-0aa5558ad39a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:57.718805 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ff648ca7-5e7d-4d51-b499-0aa5558ad39a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:57.719254 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ff648ca7-5e7d-4d51-b499-0aa5558ad39a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:57.861239 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell0:SELECT=8 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:21:57.962550 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-ff648ca7-5e7d-4d51-b499-0aa5558ad39a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:57.980847 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-ff648ca7-5e7d-4d51-b499-0aa5558ad39a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:57.984547 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-ff648ca7-5e7d-4d51-b499-0aa5558ad39a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:57.988341 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-ff648ca7-5e7d-4d51-b499-0aa5558ad39a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1405 microversion: 2.20 time: 0.300567 Jul 29 05:21:57.990159 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 56/95] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:21:57 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1405 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:21:58.316944 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-1c4e203e-df5f-43b5-b1bd-819b0eaf019b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:58.317740 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-1c4e203e-df5f-43b5-b1bd-819b0eaf019b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:58.327986 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1c4e203e-df5f-43b5-b1bd-819b0eaf019b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:58.328603 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1c4e203e-df5f-43b5-b1bd-819b0eaf019b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:58.329698 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1c4e203e-df5f-43b5-b1bd-819b0eaf019b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:58.330324 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1c4e203e-df5f-43b5-b1bd-819b0eaf019b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:58.521315 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-34abc0c6-0851-4663-b71e-97685c30f8b5 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:58.529132 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-34abc0c6-0851-4663-b71e-97685c30f8b5 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1363 microversion: 2.1 time: 1.014645 Jul 29 05:21:58.545172 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 40/96] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:57 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1363 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:21:58.553787 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-eb2c7784-64d4-487c-8628-ac63b3788bf9 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:58.554930 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-eb2c7784-64d4-487c-8628-ac63b3788bf9 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] [instance: 51207b24-620a-4479-be28-4db53ef4073e] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:58.562010 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-eb2c7784-64d4-487c-8628-ac63b3788bf9 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:58.562743 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-eb2c7784-64d4-487c-8628-ac63b3788bf9 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:58.563761 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-eb2c7784-64d4-487c-8628-ac63b3788bf9 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:58.564395 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-eb2c7784-64d4-487c-8628-ac63b3788bf9 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:58.589329 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell1:SELECT=100 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:21:58.691110 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-1c4e203e-df5f-43b5-b1bd-819b0eaf019b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:58.705990 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-1c4e203e-df5f-43b5-b1bd-819b0eaf019b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780" status: 200 len: 1366 microversion: 2.1 time: 0.390731 Jul 29 05:21:58.707080 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 57/97] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:58 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 => generated 1366 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:21:58.717272 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-3025af2f-c36c-44e6-98d5-2c6f1430ac6c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:58.718824 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-3025af2f-c36c-44e6-98d5-2c6f1430ac6c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:58.725707 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3025af2f-c36c-44e6-98d5-2c6f1430ac6c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:58.726399 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3025af2f-c36c-44e6-98d5-2c6f1430ac6c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:58.727480 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3025af2f-c36c-44e6-98d5-2c6f1430ac6c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:58.728059 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3025af2f-c36c-44e6-98d5-2c6f1430ac6c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:58.856877 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-eb2c7784-64d4-487c-8628-ac63b3788bf9 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720be309cbe14940873d774b06e91bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87396f5e6bf46f5b85720c8e365da81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:58.877729 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-eb2c7784-64d4-487c-8628-ac63b3788bf9 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] 10.222.0.49 "GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e" status: 200 len: 1314 microversion: 2.1 time: 0.330127 Jul 29 05:21:58.882090 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 41/98] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:58 2022] GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:58.934020 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-3025af2f-c36c-44e6-98d5-2c6f1430ac6c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:58.946616 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-3025af2f-c36c-44e6-98d5-2c6f1430ac6c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1321 microversion: 2.1 time: 0.234510 Jul 29 05:21:58.948227 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 58/99] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:58 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:59.011767 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-1b1cb4d3-5795-4a63-8263-0171d0985ae1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:59.012361 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-1b1cb4d3-5795-4a63-8263-0171d0985ae1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:59.019213 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1b1cb4d3-5795-4a63-8263-0171d0985ae1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:59.019684 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1b1cb4d3-5795-4a63-8263-0171d0985ae1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:59.020460 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1b1cb4d3-5795-4a63-8263-0171d0985ae1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:59.020893 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1b1cb4d3-5795-4a63-8263-0171d0985ae1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:59.276413 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-1b1cb4d3-5795-4a63-8263-0171d0985ae1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:59.286482 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-1b1cb4d3-5795-4a63-8263-0171d0985ae1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:59.288472 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-1b1cb4d3-5795-4a63-8263-0171d0985ae1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:59.290004 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-1b1cb4d3-5795-4a63-8263-0171d0985ae1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1405 microversion: 2.20 time: 0.282248 Jul 29 05:21:59.306589 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 42/100] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:21:59 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1405 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:21:59.333732 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-74765fce-dd58-45ed-b707-4b5f4ab1bb5c req-68cd8b14-7649-4ce8-96af-ee689c8a4640 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ff4221e-eadc-491b-9f3c-9b41413a63d0", "tag": "de35419f-6c42-424f-baf0-e88731e69e60"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:21:59.358673 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-74765fce-dd58-45ed-b707-4b5f4ab1bb5c req-68cd8b14-7649-4ce8-96af-ee689c8a4640 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:59.359139 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-74765fce-dd58-45ed-b707-4b5f4ab1bb5c req-68cd8b14-7649-4ce8-96af-ee689c8a4640 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:59.374984 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-74765fce-dd58-45ed-b707-4b5f4ab1bb5c req-68cd8b14-7649-4ce8-96af-ee689c8a4640 service nova] Creating event network-changed:de35419f-6c42-424f-baf0-e88731e69e60 for instance 6ff4221e-eadc-491b-9f3c-9b41413a63d0 on hv-cinder-85127 Jul 29 05:21:59.382563 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-74765fce-dd58-45ed-b707-4b5f4ab1bb5c req-68cd8b14-7649-4ce8-96af-ee689c8a4640 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058575 Jul 29 05:21:59.383857 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 59/101] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:21:59.559511 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-c81d7431-7100-4e53-a995-dd1db00de7cb tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:59.564246 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-c81d7431-7100-4e53-a995-dd1db00de7cb tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:59.572966 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c81d7431-7100-4e53-a995-dd1db00de7cb tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:59.573431 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c81d7431-7100-4e53-a995-dd1db00de7cb tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:59.574249 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c81d7431-7100-4e53-a995-dd1db00de7cb tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:59.574736 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c81d7431-7100-4e53-a995-dd1db00de7cb tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:59.729163 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-2f3d7590-d28d-4675-b8f6-6ac816902b38 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:59.730470 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-2f3d7590-d28d-4675-b8f6-6ac816902b38 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:59.737579 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2f3d7590-d28d-4675-b8f6-6ac816902b38 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:59.737757 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-c81d7431-7100-4e53-a995-dd1db00de7cb tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:21:59.738063 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2f3d7590-d28d-4675-b8f6-6ac816902b38 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:59.738873 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2f3d7590-d28d-4675-b8f6-6ac816902b38 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:59.739969 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2f3d7590-d28d-4675-b8f6-6ac816902b38 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:59.748182 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-c81d7431-7100-4e53-a995-dd1db00de7cb tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1363 microversion: 2.1 time: 0.192587 Jul 29 05:21:59.749050 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 43/102] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:59 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:21:59.904207 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-c07bb6eb-939c-4c92-bc20-ff18f5142f4d tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:21:59.904614 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-c07bb6eb-939c-4c92-bc20-ff18f5142f4d tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] [instance: 51207b24-620a-4479-be28-4db53ef4073e] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:21:59.916362 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c07bb6eb-939c-4c92-bc20-ff18f5142f4d tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:59.917357 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c07bb6eb-939c-4c92-bc20-ff18f5142f4d tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:21:59.919107 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c07bb6eb-939c-4c92-bc20-ff18f5142f4d tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:21:59.920253 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c07bb6eb-939c-4c92-bc20-ff18f5142f4d tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:00.087902 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-2f3d7590-d28d-4675-b8f6-6ac816902b38 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:00.096694 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-2f3d7590-d28d-4675-b8f6-6ac816902b38 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780" status: 200 len: 1366 microversion: 2.1 time: 0.371522 Jul 29 05:22:00.097281 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 60/103] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:59 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 => generated 1366 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:00.101259 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-c07bb6eb-939c-4c92-bc20-ff18f5142f4d tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720be309cbe14940873d774b06e91bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87396f5e6bf46f5b85720c8e365da81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:00.102754 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-27f96f93-a996-4c62-a904-89d90fcfb162 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:00.103587 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-27f96f93-a996-4c62-a904-89d90fcfb162 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:00.112265 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-c07bb6eb-939c-4c92-bc20-ff18f5142f4d tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] 10.222.0.49 "GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e" status: 200 len: 1314 microversion: 2.1 time: 0.212325 Jul 29 05:22:00.113184 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-27f96f93-a996-4c62-a904-89d90fcfb162 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:00.113789 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-27f96f93-a996-4c62-a904-89d90fcfb162 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:00.114682 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-27f96f93-a996-4c62-a904-89d90fcfb162 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:00.115188 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-27f96f93-a996-4c62-a904-89d90fcfb162 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:00.115504 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 44/104] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:21:59 2022] GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:22:00.256865 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-27f96f93-a996-4c62-a904-89d90fcfb162 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:00.264764 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-27f96f93-a996-4c62-a904-89d90fcfb162 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1321 microversion: 2.1 time: 0.166102 Jul 29 05:22:00.265358 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 61/105] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:00 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:00.313372 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-f9dfcc61-2473-4987-8506-f668f394911a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:00.313989 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-f9dfcc61-2473-4987-8506-f668f394911a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:00.321436 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f9dfcc61-2473-4987-8506-f668f394911a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:00.321893 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f9dfcc61-2473-4987-8506-f668f394911a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:00.322671 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f9dfcc61-2473-4987-8506-f668f394911a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:00.323104 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f9dfcc61-2473-4987-8506-f668f394911a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:00.461811 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-f9dfcc61-2473-4987-8506-f668f394911a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:00.470020 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-f9dfcc61-2473-4987-8506-f668f394911a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:00.472294 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-f9dfcc61-2473-4987-8506-f668f394911a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:00.473469 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-f9dfcc61-2473-4987-8506-f668f394911a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1405 microversion: 2.20 time: 0.164037 Jul 29 05:22:00.474039 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 45/106] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:22:00 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:22:00.772192 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-7924ec75-37b5-445c-9b1e-83845fa46dbd tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:00.773324 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-7924ec75-37b5-445c-9b1e-83845fa46dbd tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:00.780875 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7924ec75-37b5-445c-9b1e-83845fa46dbd tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:00.781332 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7924ec75-37b5-445c-9b1e-83845fa46dbd tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:00.782128 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7924ec75-37b5-445c-9b1e-83845fa46dbd tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:00.782658 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7924ec75-37b5-445c-9b1e-83845fa46dbd tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:00.935902 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-7924ec75-37b5-445c-9b1e-83845fa46dbd tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:00.951621 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-c533f639-203b-458f-b926-e6e89e603d2b req-cc3189a3-b341-4c0e-acb5-5bd39eefd1fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c46947-e368-441d-9e07-584e95d55780", "name": "network-vif-plugged", "status": "completed", "tag": "a271d975-09dc-4c3e-8b57-3468787c62a8"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:22:00.956855 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-7924ec75-37b5-445c-9b1e-83845fa46dbd tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1363 microversion: 2.1 time: 0.190371 Jul 29 05:22:00.965084 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 62/107] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:00 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:00.981303 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-c533f639-203b-458f-b926-e6e89e603d2b req-cc3189a3-b341-4c0e-acb5-5bd39eefd1fb service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:00.982084 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-c533f639-203b-458f-b926-e6e89e603d2b req-cc3189a3-b341-4c0e-acb5-5bd39eefd1fb service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:01.003286 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-c533f639-203b-458f-b926-e6e89e603d2b req-cc3189a3-b341-4c0e-acb5-5bd39eefd1fb service nova] Creating event network-vif-plugged:a271d975-09dc-4c3e-8b57-3468787c62a8 for instance 05c46947-e368-441d-9e07-584e95d55780 on hv-cinder-85127 Jul 29 05:22:01.010319 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-c533f639-203b-458f-b926-e6e89e603d2b req-cc3189a3-b341-4c0e-acb5-5bd39eefd1fb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063425 Jul 29 05:22:01.011720 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 46/108] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:22:01.118068 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-818de975-cf7e-43fd-ba7c-4902197f687b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:01.118654 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-818de975-cf7e-43fd-ba7c-4902197f687b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:01.125384 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-818de975-cf7e-43fd-ba7c-4902197f687b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:01.125832 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-818de975-cf7e-43fd-ba7c-4902197f687b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:01.129107 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-818de975-cf7e-43fd-ba7c-4902197f687b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:01.129559 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-818de975-cf7e-43fd-ba7c-4902197f687b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:01.135580 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-3748adc3-7cc6-4da3-831c-e5305fb43fe0 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:01.136593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-3748adc3-7cc6-4da3-831c-e5305fb43fe0 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] [instance: 51207b24-620a-4479-be28-4db53ef4073e] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:01.145323 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3748adc3-7cc6-4da3-831c-e5305fb43fe0 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:01.146150 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3748adc3-7cc6-4da3-831c-e5305fb43fe0 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:01.147337 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3748adc3-7cc6-4da3-831c-e5305fb43fe0 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:01.148156 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3748adc3-7cc6-4da3-831c-e5305fb43fe0 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:01.290749 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-818de975-cf7e-43fd-ba7c-4902197f687b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:01.294293 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-3748adc3-7cc6-4da3-831c-e5305fb43fe0 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720be309cbe14940873d774b06e91bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87396f5e6bf46f5b85720c8e365da81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:01.299482 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-818de975-cf7e-43fd-ba7c-4902197f687b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780" status: 200 len: 1366 microversion: 2.1 time: 0.184659 Jul 29 05:22:01.300757 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 63/109] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:01 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:01.305732 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-981b1fb4-3491-432a-91b9-e16bc3ff4df2 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:01.306618 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-981b1fb4-3491-432a-91b9-e16bc3ff4df2 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:01.307456 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-3748adc3-7cc6-4da3-831c-e5305fb43fe0 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] 10.222.0.49 "GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e" status: 200 len: 1314 microversion: 2.1 time: 0.176087 Jul 29 05:22:01.308333 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 47/110] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:01 2022] GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:22:01.325659 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-981b1fb4-3491-432a-91b9-e16bc3ff4df2 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:01.326343 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-981b1fb4-3491-432a-91b9-e16bc3ff4df2 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:01.327122 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-981b1fb4-3491-432a-91b9-e16bc3ff4df2 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:01.327590 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-981b1fb4-3491-432a-91b9-e16bc3ff4df2 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:01.476871 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-981b1fb4-3491-432a-91b9-e16bc3ff4df2 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:01.486221 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-981b1fb4-3491-432a-91b9-e16bc3ff4df2 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1321 microversion: 2.1 time: 0.183846 Jul 29 05:22:01.487977 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 64/111] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:01 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:01.500728 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-af641bf4-99ba-4f8f-9553-a33421327754 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:01.501342 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-af641bf4-99ba-4f8f-9553-a33421327754 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:01.508953 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-af641bf4-99ba-4f8f-9553-a33421327754 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:01.509426 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-af641bf4-99ba-4f8f-9553-a33421327754 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:01.510416 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-af641bf4-99ba-4f8f-9553-a33421327754 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:01.511089 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-af641bf4-99ba-4f8f-9553-a33421327754 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:01.693498 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-af641bf4-99ba-4f8f-9553-a33421327754 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:01.707315 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-af641bf4-99ba-4f8f-9553-a33421327754 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:01.708855 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-af641bf4-99ba-4f8f-9553-a33421327754 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:01.710593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-af641bf4-99ba-4f8f-9553-a33421327754 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1405 microversion: 2.20 time: 0.213776 Jul 29 05:22:01.712045 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 48/112] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:22:01 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1405 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:22:01.989936 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-1d1a309a-cc95-4b3b-83c2-5414b6d755e2 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:01.991068 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-1d1a309a-cc95-4b3b-83c2-5414b6d755e2 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:02.002767 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1d1a309a-cc95-4b3b-83c2-5414b6d755e2 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:02.004365 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1d1a309a-cc95-4b3b-83c2-5414b6d755e2 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:02.005816 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1d1a309a-cc95-4b3b-83c2-5414b6d755e2 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:02.006600 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1d1a309a-cc95-4b3b-83c2-5414b6d755e2 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:02.155450 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-1d1a309a-cc95-4b3b-83c2-5414b6d755e2 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:02.167030 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-1d1a309a-cc95-4b3b-83c2-5414b6d755e2 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1363 microversion: 2.1 time: 0.183448 Jul 29 05:22:02.179757 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 65/113] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:01 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:02.327622 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-54b46209-28bb-4feb-94be-1a9c2a3e7d5f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:02.329926 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-54b46209-28bb-4feb-94be-1a9c2a3e7d5f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:02.332877 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-0e4054ac-c3a3-4ff7-80df-58641b558f29 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:02.333568 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-0e4054ac-c3a3-4ff7-80df-58641b558f29 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] [instance: 51207b24-620a-4479-be28-4db53ef4073e] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:02.341027 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-54b46209-28bb-4feb-94be-1a9c2a3e7d5f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:02.342710 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-54b46209-28bb-4feb-94be-1a9c2a3e7d5f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:02.343950 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-54b46209-28bb-4feb-94be-1a9c2a3e7d5f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:02.346198 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0e4054ac-c3a3-4ff7-80df-58641b558f29 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:02.346667 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0e4054ac-c3a3-4ff7-80df-58641b558f29 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:02.346929 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-54b46209-28bb-4feb-94be-1a9c2a3e7d5f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:02.349693 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0e4054ac-c3a3-4ff7-80df-58641b558f29 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:02.350215 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0e4054ac-c3a3-4ff7-80df-58641b558f29 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:02.538079 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-0e4054ac-c3a3-4ff7-80df-58641b558f29 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720be309cbe14940873d774b06e91bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87396f5e6bf46f5b85720c8e365da81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:02.552650 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-0e4054ac-c3a3-4ff7-80df-58641b558f29 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] 10.222.0.49 "GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e" status: 200 len: 1314 microversion: 2.1 time: 0.223712 Jul 29 05:22:02.554936 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 66/114] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:02 2022] GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:22:02.572403 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-7b5edd3c-182f-402d-b0c3-b92ffeb03d57 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:02.573495 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-7b5edd3c-182f-402d-b0c3-b92ffeb03d57 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:02.576191 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:22:02.584608 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7b5edd3c-182f-402d-b0c3-b92ffeb03d57 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:02.585692 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7b5edd3c-182f-402d-b0c3-b92ffeb03d57 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:02.586361 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7b5edd3c-182f-402d-b0c3-b92ffeb03d57 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:02.587292 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7b5edd3c-182f-402d-b0c3-b92ffeb03d57 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:02.862303 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-7b5edd3c-182f-402d-b0c3-b92ffeb03d57 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:02.873955 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-7b5edd3c-182f-402d-b0c3-b92ffeb03d57 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1321 microversion: 2.1 time: 0.317563 Jul 29 05:22:02.874546 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 67/115] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:02 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1321 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:02.887420 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-00b29d94-50f1-4279-8e57-8dbdaa53fa32 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:02.891747 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-00b29d94-50f1-4279-8e57-8dbdaa53fa32 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:02.906782 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-00b29d94-50f1-4279-8e57-8dbdaa53fa32 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:02.907252 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-00b29d94-50f1-4279-8e57-8dbdaa53fa32 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:02.908615 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-00b29d94-50f1-4279-8e57-8dbdaa53fa32 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:02.909035 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-00b29d94-50f1-4279-8e57-8dbdaa53fa32 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:03.010062 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-54b46209-28bb-4feb-94be-1a9c2a3e7d5f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:03.021418 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-54b46209-28bb-4feb-94be-1a9c2a3e7d5f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780" status: 200 len: 1366 microversion: 2.1 time: 0.700926 Jul 29 05:22:03.022848 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 49/116] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:02 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 => generated 1366 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:03.078270 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-00b29d94-50f1-4279-8e57-8dbdaa53fa32 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:03.087923 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-00b29d94-50f1-4279-8e57-8dbdaa53fa32 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:03.091057 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-00b29d94-50f1-4279-8e57-8dbdaa53fa32 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:03.093775 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-00b29d94-50f1-4279-8e57-8dbdaa53fa32 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1405 microversion: 2.20 time: 0.214239 Jul 29 05:22:03.094422 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 68/117] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:22:02 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1405 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:22:03.193014 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-14fd9503-bd11-4845-9176-729ffc6029a0 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:03.193629 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-14fd9503-bd11-4845-9176-729ffc6029a0 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:03.200648 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-14fd9503-bd11-4845-9176-729ffc6029a0 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:03.201173 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-14fd9503-bd11-4845-9176-729ffc6029a0 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:03.204547 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-14fd9503-bd11-4845-9176-729ffc6029a0 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:03.204547 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-14fd9503-bd11-4845-9176-729ffc6029a0 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:03.362886 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-14fd9503-bd11-4845-9176-729ffc6029a0 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:03.371068 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-14fd9503-bd11-4845-9176-729ffc6029a0 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1363 microversion: 2.1 time: 0.181998 Jul 29 05:22:03.371769 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 50/118] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:03 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:03.574866 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-ad05d49e-7327-496a-8a46-b3e81112a8b9 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:03.575507 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-ad05d49e-7327-496a-8a46-b3e81112a8b9 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] [instance: 51207b24-620a-4479-be28-4db53ef4073e] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:03.581992 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ad05d49e-7327-496a-8a46-b3e81112a8b9 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:03.582514 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ad05d49e-7327-496a-8a46-b3e81112a8b9 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:03.583371 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ad05d49e-7327-496a-8a46-b3e81112a8b9 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:03.583831 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ad05d49e-7327-496a-8a46-b3e81112a8b9 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:03.733798 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-ad05d49e-7327-496a-8a46-b3e81112a8b9 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720be309cbe14940873d774b06e91bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87396f5e6bf46f5b85720c8e365da81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:03.743005 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-ad05d49e-7327-496a-8a46-b3e81112a8b9 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] 10.222.0.49 "GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e" status: 200 len: 1502 microversion: 2.1 time: 0.171942 Jul 29 05:22:03.743840 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 69/119] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:03 2022] GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e => generated 1502 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:03.913483 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-9a8fa739-9c14-4bc5-9aff-9b07a3f59e2e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:03.915124 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-9a8fa739-9c14-4bc5-9aff-9b07a3f59e2e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:03.925723 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9a8fa739-9c14-4bc5-9aff-9b07a3f59e2e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:03.926468 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9a8fa739-9c14-4bc5-9aff-9b07a3f59e2e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:03.928109 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9a8fa739-9c14-4bc5-9aff-9b07a3f59e2e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:03.929764 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9a8fa739-9c14-4bc5-9aff-9b07a3f59e2e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:04.068812 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-59024719-3a02-4610-b5f5-71638fe6f310 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:04.072180 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-59024719-3a02-4610-b5f5-71638fe6f310 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:04.087675 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-59024719-3a02-4610-b5f5-71638fe6f310 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:04.091099 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-59024719-3a02-4610-b5f5-71638fe6f310 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:04.097046 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-59024719-3a02-4610-b5f5-71638fe6f310 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:04.098110 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-59024719-3a02-4610-b5f5-71638fe6f310 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:04.310533 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-9a8fa739-9c14-4bc5-9aff-9b07a3f59e2e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:04.322564 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-9a8fa739-9c14-4bc5-9aff-9b07a3f59e2e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1515 microversion: 2.1 time: 0.415636 Jul 29 05:22:04.324329 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 51/120] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:03 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1515 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:04.340495 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-ee2b97d8-caaa-4689-b696-d71346f2e41b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:04.341524 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-ee2b97d8-caaa-4689-b696-d71346f2e41b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:04.368770 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ee2b97d8-caaa-4689-b696-d71346f2e41b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:04.372954 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-59024719-3a02-4610-b5f5-71638fe6f310 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:04.373319 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ee2b97d8-caaa-4689-b696-d71346f2e41b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:04.378323 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ee2b97d8-caaa-4689-b696-d71346f2e41b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:04.382107 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-59024719-3a02-4610-b5f5-71638fe6f310 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780" status: 200 len: 1366 microversion: 2.1 time: 0.340558 Jul 29 05:22:04.382413 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ee2b97d8-caaa-4689-b696-d71346f2e41b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:04.383436 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 70/121] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:04 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 => generated 1366 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:22:04.409048 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-4b32ef18-99da-4ff7-b514-3b74427b7252 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:22:04.409048 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-4b32ef18-99da-4ff7-b514-3b74427b7252 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:04.423326 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4b32ef18-99da-4ff7-b514-3b74427b7252 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:04.424122 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4b32ef18-99da-4ff7-b514-3b74427b7252 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:04.425214 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4b32ef18-99da-4ff7-b514-3b74427b7252 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:04.425692 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4b32ef18-99da-4ff7-b514-3b74427b7252 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:04.508487 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.objects.instance [None req-4b32ef18-99da-4ff7-b514-3b74427b7252 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lazy-loading 'flavor' on Instance uuid a6c67286-4bb1-4dc6-87ba-4c21f3ff863a {{(pid=117821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:22:04.569554 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell1:SELECT=100 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:22:04.645267 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-ee2b97d8-caaa-4689-b696-d71346f2e41b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:04.653660 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-ee2b97d8-caaa-4689-b696-d71346f2e41b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:04.655817 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-ee2b97d8-caaa-4689-b696-d71346f2e41b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:04.657184 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-ee2b97d8-caaa-4689-b696-d71346f2e41b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1405 microversion: 2.20 time: 0.329122 Jul 29 05:22:04.667878 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 52/122] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:22:04 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1405 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:22:04.679899 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-e25ac692-efb9-48c8-9e48-9afebeb0855a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:04.680802 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-e25ac692-efb9-48c8-9e48-9afebeb0855a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:04.699725 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-4b32ef18-99da-4ff7-b514-3b74427b7252 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "POST /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a/action" status: 200 len: 32 microversion: 2.1 time: 0.295657 Jul 29 05:22:04.699725 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 71/123] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Jul 29 05:22:04 2022] POST /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a/action => generated 32 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 05:22:04.708115 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e25ac692-efb9-48c8-9e48-9afebeb0855a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:04.708324 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-228e6be9-d5df-46bc-a2b6-7e4b1e735bff tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:04.709176 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-228e6be9-d5df-46bc-a2b6-7e4b1e735bff tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:04.709903 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e25ac692-efb9-48c8-9e48-9afebeb0855a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:04.711078 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e25ac692-efb9-48c8-9e48-9afebeb0855a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:04.711807 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e25ac692-efb9-48c8-9e48-9afebeb0855a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:04.717933 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-228e6be9-d5df-46bc-a2b6-7e4b1e735bff tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:04.718349 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-228e6be9-d5df-46bc-a2b6-7e4b1e735bff tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:04.719231 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-228e6be9-d5df-46bc-a2b6-7e4b1e735bff tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:04.722266 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-228e6be9-d5df-46bc-a2b6-7e4b1e735bff tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:04.898590 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-228e6be9-d5df-46bc-a2b6-7e4b1e735bff tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:04.906234 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-228e6be9-d5df-46bc-a2b6-7e4b1e735bff tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1521 microversion: 2.1 time: 0.207012 Jul 29 05:22:04.906815 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 72/124] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:04 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:22:04.920126 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-e25ac692-efb9-48c8-9e48-9afebeb0855a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:04.928291 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-e25ac692-efb9-48c8-9e48-9afebeb0855a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1363 microversion: 2.1 time: 0.259174 Jul 29 05:22:04.928965 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 53/125] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:04 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:05.404424 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-ff8a5685-1745-47f9-b671-a4ce7e4f2e3e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:05.405041 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-ff8a5685-1745-47f9-b671-a4ce7e4f2e3e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:05.411776 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ff8a5685-1745-47f9-b671-a4ce7e4f2e3e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:05.412230 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ff8a5685-1745-47f9-b671-a4ce7e4f2e3e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:05.413268 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ff8a5685-1745-47f9-b671-a4ce7e4f2e3e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:05.413708 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ff8a5685-1745-47f9-b671-a4ce7e4f2e3e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:05.626565 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-ff8a5685-1745-47f9-b671-a4ce7e4f2e3e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:05.638815 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-ff8a5685-1745-47f9-b671-a4ce7e4f2e3e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780" status: 200 len: 1366 microversion: 2.1 time: 0.238275 Jul 29 05:22:05.639426 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 73/126] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:05 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:05.683409 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-e653414c-70c5-48b8-bad7-cfd8cf3685ad tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:05.684024 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-e653414c-70c5-48b8-bad7-cfd8cf3685ad tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:05.685991 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell0:SELECT=4 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:22:05.691652 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e653414c-70c5-48b8-bad7-cfd8cf3685ad tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:05.692106 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e653414c-70c5-48b8-bad7-cfd8cf3685ad tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:05.692879 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e653414c-70c5-48b8-bad7-cfd8cf3685ad tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:05.693308 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e653414c-70c5-48b8-bad7-cfd8cf3685ad tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:05.847296 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-e653414c-70c5-48b8-bad7-cfd8cf3685ad tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:05.856420 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-e653414c-70c5-48b8-bad7-cfd8cf3685ad tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:05.857980 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-e653414c-70c5-48b8-bad7-cfd8cf3685ad tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:05.859273 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-e653414c-70c5-48b8-bad7-cfd8cf3685ad tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1405 microversion: 2.20 time: 0.179784 Jul 29 05:22:05.860074 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 54/127] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:22:05 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1405 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:22:05.927914 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-29529eac-d747-4853-b0c5-96a7525db3c1 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:05.928524 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-29529eac-d747-4853-b0c5-96a7525db3c1 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:05.934629 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-29529eac-d747-4853-b0c5-96a7525db3c1 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:05.935113 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-29529eac-d747-4853-b0c5-96a7525db3c1 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:05.936219 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-29529eac-d747-4853-b0c5-96a7525db3c1 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:05.936998 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-29529eac-d747-4853-b0c5-96a7525db3c1 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:05.951765 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-eccde403-bfcf-4c7b-a045-ba9ee0de5919 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:05.953175 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-eccde403-bfcf-4c7b-a045-ba9ee0de5919 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:05.961597 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-eccde403-bfcf-4c7b-a045-ba9ee0de5919 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:05.962045 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-eccde403-bfcf-4c7b-a045-ba9ee0de5919 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:05.963502 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-eccde403-bfcf-4c7b-a045-ba9ee0de5919 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:05.964178 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-eccde403-bfcf-4c7b-a045-ba9ee0de5919 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:06.092152 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-29529eac-d747-4853-b0c5-96a7525db3c1 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:06.104011 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-29529eac-d747-4853-b0c5-96a7525db3c1 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1521 microversion: 2.1 time: 0.180445 Jul 29 05:22:06.104604 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 74/128] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:05 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:22:06.124754 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-eccde403-bfcf-4c7b-a045-ba9ee0de5919 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:06.132493 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-eccde403-bfcf-4c7b-a045-ba9ee0de5919 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1363 microversion: 2.1 time: 0.186053 Jul 29 05:22:06.133076 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 55/129] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:05 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:06.659371 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-70f08cea-5910-4344-b38f-41cff466c0cb tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:06.659988 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-70f08cea-5910-4344-b38f-41cff466c0cb tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:06.666404 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-70f08cea-5910-4344-b38f-41cff466c0cb tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:06.666988 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-70f08cea-5910-4344-b38f-41cff466c0cb tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:06.667777 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-70f08cea-5910-4344-b38f-41cff466c0cb tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:06.668377 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-70f08cea-5910-4344-b38f-41cff466c0cb tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:06.812206 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-70f08cea-5910-4344-b38f-41cff466c0cb tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:06.820865 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-70f08cea-5910-4344-b38f-41cff466c0cb tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780" status: 200 len: 1366 microversion: 2.1 time: 0.165666 Jul 29 05:22:06.821613 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 75/130] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:06 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:06.886513 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-2a8a1ee1-620d-48f5-8e5d-89d77cf2d3c5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:06.893755 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-2a8a1ee1-620d-48f5-8e5d-89d77cf2d3c5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:06.905548 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2a8a1ee1-620d-48f5-8e5d-89d77cf2d3c5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:06.909539 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2a8a1ee1-620d-48f5-8e5d-89d77cf2d3c5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:06.910379 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2a8a1ee1-620d-48f5-8e5d-89d77cf2d3c5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:06.910908 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2a8a1ee1-620d-48f5-8e5d-89d77cf2d3c5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:07.065667 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-2a8a1ee1-620d-48f5-8e5d-89d77cf2d3c5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:07.075662 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-2a8a1ee1-620d-48f5-8e5d-89d77cf2d3c5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:07.077178 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-2a8a1ee1-620d-48f5-8e5d-89d77cf2d3c5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:07.078305 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-2a8a1ee1-620d-48f5-8e5d-89d77cf2d3c5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1405 microversion: 2.20 time: 0.196096 Jul 29 05:22:07.078865 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 56/131] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:22:06 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1405 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:22:07.124772 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-29dbe544-bd49-4fd0-8092-712b3cedce58 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:07.125382 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-29dbe544-bd49-4fd0-8092-712b3cedce58 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:07.133002 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-29dbe544-bd49-4fd0-8092-712b3cedce58 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:07.133454 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-29dbe544-bd49-4fd0-8092-712b3cedce58 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:07.134231 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-29dbe544-bd49-4fd0-8092-712b3cedce58 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:07.134667 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-29dbe544-bd49-4fd0-8092-712b3cedce58 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:07.165244 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-48bd6c1a-72d5-46e8-9c2f-90d0d7f92c1f tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:07.165860 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-48bd6c1a-72d5-46e8-9c2f-90d0d7f92c1f tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:07.173303 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-48bd6c1a-72d5-46e8-9c2f-90d0d7f92c1f tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:07.174016 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-48bd6c1a-72d5-46e8-9c2f-90d0d7f92c1f tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:07.175662 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-48bd6c1a-72d5-46e8-9c2f-90d0d7f92c1f tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:07.176412 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-48bd6c1a-72d5-46e8-9c2f-90d0d7f92c1f tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:07.289131 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-29dbe544-bd49-4fd0-8092-712b3cedce58 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:07.298497 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-29dbe544-bd49-4fd0-8092-712b3cedce58 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1521 microversion: 2.1 time: 0.177385 Jul 29 05:22:07.313555 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 76/132] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:07 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:07.334216 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-48bd6c1a-72d5-46e8-9c2f-90d0d7f92c1f tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:07.344115 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-48bd6c1a-72d5-46e8-9c2f-90d0d7f92c1f tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1363 microversion: 2.1 time: 0.187799 Jul 29 05:22:07.344874 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 57/133] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:07 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:07.852230 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-18be3ca7-b8ad-4c43-b798-86dc977dbc9f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:07.858620 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-18be3ca7-b8ad-4c43-b798-86dc977dbc9f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:07.870493 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-18be3ca7-b8ad-4c43-b798-86dc977dbc9f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:07.870952 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-18be3ca7-b8ad-4c43-b798-86dc977dbc9f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:07.872052 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-18be3ca7-b8ad-4c43-b798-86dc977dbc9f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:07.872299 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-18be3ca7-b8ad-4c43-b798-86dc977dbc9f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:08.084709 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-18be3ca7-b8ad-4c43-b798-86dc977dbc9f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:08.092506 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-18be3ca7-b8ad-4c43-b798-86dc977dbc9f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780" status: 200 len: 1366 microversion: 2.1 time: 0.253802 Jul 29 05:22:08.093881 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 77/134] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:07 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:08.104603 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-5d5f4dcb-bc32-4d2c-8ca0-63e4ceebec86 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:08.105218 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-5d5f4dcb-bc32-4d2c-8ca0-63e4ceebec86 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:08.112575 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5d5f4dcb-bc32-4d2c-8ca0-63e4ceebec86 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:08.113255 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5d5f4dcb-bc32-4d2c-8ca0-63e4ceebec86 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:08.114243 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5d5f4dcb-bc32-4d2c-8ca0-63e4ceebec86 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:08.114840 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5d5f4dcb-bc32-4d2c-8ca0-63e4ceebec86 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:08.296986 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-5d5f4dcb-bc32-4d2c-8ca0-63e4ceebec86 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:08.300403 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell1:SELECT=100 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:22:08.307826 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-5d5f4dcb-bc32-4d2c-8ca0-63e4ceebec86 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:08.309561 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-5d5f4dcb-bc32-4d2c-8ca0-63e4ceebec86 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:08.310652 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-5d5f4dcb-bc32-4d2c-8ca0-63e4ceebec86 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1405 microversion: 2.20 time: 0.211806 Jul 29 05:22:08.311448 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 58/135] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:22:08 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1405 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:22:08.320102 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-3d356041-2bae-4de6-8962-d4a0919a299f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:08.320969 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-3d356041-2bae-4de6-8962-d4a0919a299f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:08.328050 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3d356041-2bae-4de6-8962-d4a0919a299f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:08.328946 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3d356041-2bae-4de6-8962-d4a0919a299f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:08.330503 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3d356041-2bae-4de6-8962-d4a0919a299f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:08.331310 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3d356041-2bae-4de6-8962-d4a0919a299f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:08.370988 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-5a46d788-0903-415d-b1b9-8f35058b7950 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:08.371823 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-5a46d788-0903-415d-b1b9-8f35058b7950 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:08.383971 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5a46d788-0903-415d-b1b9-8f35058b7950 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:08.384436 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5a46d788-0903-415d-b1b9-8f35058b7950 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:08.385288 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5a46d788-0903-415d-b1b9-8f35058b7950 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:08.385817 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5a46d788-0903-415d-b1b9-8f35058b7950 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:08.531707 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-3d356041-2bae-4de6-8962-d4a0919a299f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:08.543614 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-3d356041-2bae-4de6-8962-d4a0919a299f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1521 microversion: 2.1 time: 0.227456 Jul 29 05:22:08.544577 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 78/136] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:08 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:08.560698 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-5d6b6bb1-50d2-4777-b54b-41574a85e98c tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d22c7627-5552-4aef-ba8c-242d2ab567dd"}} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:22:08.567883 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-5d6b6bb1-50d2-4777-b54b-41574a85e98c tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] [instance: 51207b24-620a-4479-be28-4db53ef4073e] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:08.585485 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5d6b6bb1-50d2-4777-b54b-41574a85e98c tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:08.585938 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5d6b6bb1-50d2-4777-b54b-41574a85e98c tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:08.586722 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5d6b6bb1-50d2-4777-b54b-41574a85e98c tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:08.587160 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5d6b6bb1-50d2-4777-b54b-41574a85e98c tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:08.962411 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-5a46d788-0903-415d-b1b9-8f35058b7950 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:08.981996 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-5a46d788-0903-415d-b1b9-8f35058b7950 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1363 microversion: 2.1 time: 0.616731 Jul 29 05:22:08.984967 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 59/137] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:08 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1363 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:09.114609 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-3828951e-5888-4be8-93e4-15ffcbc476a9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:09.115254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-3828951e-5888-4be8-93e4-15ffcbc476a9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:09.135098 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3828951e-5888-4be8-93e4-15ffcbc476a9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:09.135618 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3828951e-5888-4be8-93e4-15ffcbc476a9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:09.136428 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3828951e-5888-4be8-93e4-15ffcbc476a9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:09.136868 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3828951e-5888-4be8-93e4-15ffcbc476a9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:09.203796 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-5d6b6bb1-50d2-4777-b54b-41574a85e98c tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] 10.222.0.49 "POST /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.657401 Jul 29 05:22:09.204482 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 79/138] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Jul 29 05:22:08 2022] POST /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e/os-volume_attachments => generated 194 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:22:09.336514 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-4c4160b2-4fba-4887-8c42-fd2b7fc76bd8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:09.337229 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-4c4160b2-4fba-4887-8c42-fd2b7fc76bd8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:09.344205 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4c4160b2-4fba-4887-8c42-fd2b7fc76bd8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:09.344630 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4c4160b2-4fba-4887-8c42-fd2b7fc76bd8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:09.346392 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4c4160b2-4fba-4887-8c42-fd2b7fc76bd8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:09.347036 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4c4160b2-4fba-4887-8c42-fd2b7fc76bd8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:09.549926 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-4c4160b2-4fba-4887-8c42-fd2b7fc76bd8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:09.567574 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-4c4160b2-4fba-4887-8c42-fd2b7fc76bd8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:09.570735 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-4c4160b2-4fba-4887-8c42-fd2b7fc76bd8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:09.572975 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-4c4160b2-4fba-4887-8c42-fd2b7fc76bd8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1405 microversion: 2.20 time: 0.240944 Jul 29 05:22:09.574420 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 80/139] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:22:09 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1405 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:22:09.583218 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-1e5035fc-de51-4f40-aa39-04737d61969f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:09.584391 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-1e5035fc-de51-4f40-aa39-04737d61969f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:09.597498 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1e5035fc-de51-4f40-aa39-04737d61969f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:09.598406 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1e5035fc-de51-4f40-aa39-04737d61969f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:09.599894 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1e5035fc-de51-4f40-aa39-04737d61969f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:09.600675 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1e5035fc-de51-4f40-aa39-04737d61969f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:09.737734 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-3828951e-5888-4be8-93e4-15ffcbc476a9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:09.754621 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-3828951e-5888-4be8-93e4-15ffcbc476a9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780" status: 200 len: 1555 microversion: 2.1 time: 0.644000 Jul 29 05:22:09.768452 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 60/140] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:09 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 => generated 1555 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:22:09.800301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-b5de0331-e910-4c8b-bd85-f3ab464bb1aa tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:09.801138 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-b5de0331-e910-4c8b-bd85-f3ab464bb1aa tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:09.812182 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b5de0331-e910-4c8b-bd85-f3ab464bb1aa tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:09.812992 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b5de0331-e910-4c8b-bd85-f3ab464bb1aa tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:09.815333 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b5de0331-e910-4c8b-bd85-f3ab464bb1aa tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:09.816153 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b5de0331-e910-4c8b-bd85-f3ab464bb1aa tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:09.832008 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-1e5035fc-de51-4f40-aa39-04737d61969f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:09.841242 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-1e5035fc-de51-4f40-aa39-04737d61969f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1521 microversion: 2.1 time: 0.265359 Jul 29 05:22:09.842202 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 81/141] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:09 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:10.029195 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-8e8a7e17-4f7a-49f0-a018-0106a51d7e0e tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:10.030301 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-8e8a7e17-4f7a-49f0-a018-0106a51d7e0e tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:10.044408 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-b5de0331-e910-4c8b-bd85-f3ab464bb1aa tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.252707 Jul 29 05:22:10.045484 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 61/142] 10.222.0.49 () {58 vars in 1275 bytes} [Fri Jul 29 05:22:09 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780/os-interface => generated 284 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:22:10.058462 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8e8a7e17-4f7a-49f0-a018-0106a51d7e0e tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:10.059223 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8e8a7e17-4f7a-49f0-a018-0106a51d7e0e tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:10.060672 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8e8a7e17-4f7a-49f0-a018-0106a51d7e0e tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:10.061409 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8e8a7e17-4f7a-49f0-a018-0106a51d7e0e tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:10.402319 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-8e8a7e17-4f7a-49f0-a018-0106a51d7e0e tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:10.426488 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-8e8a7e17-4f7a-49f0-a018-0106a51d7e0e tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1363 microversion: 2.1 time: 0.404072 Jul 29 05:22:10.435601 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 82/143] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:10 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1363 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:10.610051 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-e28aadff-321f-4133-8e95-86ed0219dd4d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:10.612776 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-e28aadff-321f-4133-8e95-86ed0219dd4d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:10.621998 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e28aadff-321f-4133-8e95-86ed0219dd4d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:10.623174 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e28aadff-321f-4133-8e95-86ed0219dd4d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:10.624644 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e28aadff-321f-4133-8e95-86ed0219dd4d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:10.625328 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e28aadff-321f-4133-8e95-86ed0219dd4d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:10.883053 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-3d3e9bc2-e7bc-420b-97b0-9452b6c69569 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:10.885134 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-3d3e9bc2-e7bc-420b-97b0-9452b6c69569 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:10.894877 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3d3e9bc2-e7bc-420b-97b0-9452b6c69569 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:10.896058 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3d3e9bc2-e7bc-420b-97b0-9452b6c69569 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:10.897798 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3d3e9bc2-e7bc-420b-97b0-9452b6c69569 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:10.898787 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3d3e9bc2-e7bc-420b-97b0-9452b6c69569 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:11.087207 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-e28aadff-321f-4133-8e95-86ed0219dd4d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:11.116695 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-e28aadff-321f-4133-8e95-86ed0219dd4d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:11.118947 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-e28aadff-321f-4133-8e95-86ed0219dd4d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:11.122271 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-e28aadff-321f-4133-8e95-86ed0219dd4d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1405 microversion: 2.20 time: 0.515325 Jul 29 05:22:11.123479 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 62/144] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:22:10 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1405 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:22:11.480046 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-6fb32530-3e69-472c-b8cf-5fa6685b3848 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:11.489772 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-6fb32530-3e69-472c-b8cf-5fa6685b3848 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:11.512487 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-3d3e9bc2-e7bc-420b-97b0-9452b6c69569 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:11.523748 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6fb32530-3e69-472c-b8cf-5fa6685b3848 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:11.526413 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-3d3e9bc2-e7bc-420b-97b0-9452b6c69569 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1521 microversion: 2.1 time: 0.654924 Jul 29 05:22:11.527005 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6fb32530-3e69-472c-b8cf-5fa6685b3848 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:11.527645 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 83/145] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:10 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1521 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:11.532351 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6fb32530-3e69-472c-b8cf-5fa6685b3848 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:11.533185 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6fb32530-3e69-472c-b8cf-5fa6685b3848 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:12.008635 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-6fb32530-3e69-472c-b8cf-5fa6685b3848 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:12.018443 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-6fb32530-3e69-472c-b8cf-5fa6685b3848 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1363 microversion: 2.1 time: 0.554883 Jul 29 05:22:12.019599 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 63/146] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:11 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1363 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:22:12.168361 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-7f1719ca-78c6-492d-a458-872eb4e83f3b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:12.174820 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-7f1719ca-78c6-492d-a458-872eb4e83f3b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:12.220738 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7f1719ca-78c6-492d-a458-872eb4e83f3b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:12.228263 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7f1719ca-78c6-492d-a458-872eb4e83f3b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:12.236525 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7f1719ca-78c6-492d-a458-872eb4e83f3b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:12.237673 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7f1719ca-78c6-492d-a458-872eb4e83f3b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:12.435546 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-e8acb140-d053-412e-bb88-737d26d0d2a4 req-28f9bfc7-709d-49bd-a465-9a4aa675c3da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05c46947-e368-441d-9e07-584e95d55780", "tag": "a271d975-09dc-4c3e-8b57-3468787c62a8"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:22:12.466387 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-e8acb140-d053-412e-bb88-737d26d0d2a4 req-28f9bfc7-709d-49bd-a465-9a4aa675c3da service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:12.467159 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-e8acb140-d053-412e-bb88-737d26d0d2a4 req-28f9bfc7-709d-49bd-a465-9a4aa675c3da service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:12.482030 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-e8acb140-d053-412e-bb88-737d26d0d2a4 req-28f9bfc7-709d-49bd-a465-9a4aa675c3da service nova] Creating event network-changed:a271d975-09dc-4c3e-8b57-3468787c62a8 for instance 05c46947-e368-441d-9e07-584e95d55780 on hv-cinder-85127 Jul 29 05:22:12.489178 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-e8acb140-d053-412e-bb88-737d26d0d2a4 req-28f9bfc7-709d-49bd-a465-9a4aa675c3da service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077368 Jul 29 05:22:12.490547 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 64/147] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:22:12.557912 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-7f1719ca-78c6-492d-a458-872eb4e83f3b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:12.566935 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-0922f9d7-245e-4625-ad2b-5959862c86af tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:12.567919 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-0922f9d7-245e-4625-ad2b-5959862c86af tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:12.573335 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-7f1719ca-78c6-492d-a458-872eb4e83f3b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:12.576029 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-7f1719ca-78c6-492d-a458-872eb4e83f3b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:12.576727 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0922f9d7-245e-4625-ad2b-5959862c86af tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:12.577483 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0922f9d7-245e-4625-ad2b-5959862c86af tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:12.577872 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-7f1719ca-78c6-492d-a458-872eb4e83f3b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1405 microversion: 2.20 time: 0.433176 Jul 29 05:22:12.578503 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0922f9d7-245e-4625-ad2b-5959862c86af tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:12.579056 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 84/148] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:22:12 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1405 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:22:12.579499 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0922f9d7-245e-4625-ad2b-5959862c86af tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:12.757356 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-0922f9d7-245e-4625-ad2b-5959862c86af tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:12.770635 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-0922f9d7-245e-4625-ad2b-5959862c86af tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1521 microversion: 2.1 time: 0.208733 Jul 29 05:22:12.773016 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 65/149] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:12 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:22:13.042072 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-9910bcaf-ceed-4ae8-8232-4014bef3fdf1 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:13.042749 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-9910bcaf-ceed-4ae8-8232-4014bef3fdf1 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:13.062891 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9910bcaf-ceed-4ae8-8232-4014bef3fdf1 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:13.063439 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9910bcaf-ceed-4ae8-8232-4014bef3fdf1 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:13.066787 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9910bcaf-ceed-4ae8-8232-4014bef3fdf1 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:13.067564 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9910bcaf-ceed-4ae8-8232-4014bef3fdf1 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:13.136573 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:22:13.347500 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-9910bcaf-ceed-4ae8-8232-4014bef3fdf1 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:13.359725 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-9910bcaf-ceed-4ae8-8232-4014bef3fdf1 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1363 microversion: 2.1 time: 0.321978 Jul 29 05:22:13.367406 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 85/150] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:13 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1363 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:13.602487 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-00e4a486-b0ad-4ff0-9377-371f135a41d5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:13.603096 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-00e4a486-b0ad-4ff0-9377-371f135a41d5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:13.605508 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:22:13.616227 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-00e4a486-b0ad-4ff0-9377-371f135a41d5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:13.616868 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-00e4a486-b0ad-4ff0-9377-371f135a41d5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:13.618121 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-00e4a486-b0ad-4ff0-9377-371f135a41d5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:13.618806 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-00e4a486-b0ad-4ff0-9377-371f135a41d5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:13.807193 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-cf04aef7-5363-4c0d-953c-46436dcbe2bd tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:13.808181 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-cf04aef7-5363-4c0d-953c-46436dcbe2bd tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:13.849318 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-cf04aef7-5363-4c0d-953c-46436dcbe2bd tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:13.854739 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-cf04aef7-5363-4c0d-953c-46436dcbe2bd tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:13.863558 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-cf04aef7-5363-4c0d-953c-46436dcbe2bd tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:13.865003 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-cf04aef7-5363-4c0d-953c-46436dcbe2bd tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:14.050433 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-00e4a486-b0ad-4ff0-9377-371f135a41d5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:14.066044 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-00e4a486-b0ad-4ff0-9377-371f135a41d5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:14.068114 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-00e4a486-b0ad-4ff0-9377-371f135a41d5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:14.072591 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-00e4a486-b0ad-4ff0-9377-371f135a41d5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1405 microversion: 2.20 time: 0.473940 Jul 29 05:22:14.073423 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 66/151] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:22:13 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1405 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:22:14.285634 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-cf04aef7-5363-4c0d-953c-46436dcbe2bd tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:14.297216 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-cf04aef7-5363-4c0d-953c-46436dcbe2bd tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1521 microversion: 2.1 time: 0.505188 Jul 29 05:22:14.313213 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 86/152] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:13 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1521 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:14.386080 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-ac170ef2-1df6-4aea-844b-ffcca27f950f tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:14.386756 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-ac170ef2-1df6-4aea-844b-ffcca27f950f tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:14.408822 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ac170ef2-1df6-4aea-844b-ffcca27f950f tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:14.409297 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ac170ef2-1df6-4aea-844b-ffcca27f950f tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:14.414743 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ac170ef2-1df6-4aea-844b-ffcca27f950f tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:14.417463 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ac170ef2-1df6-4aea-844b-ffcca27f950f tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:14.837733 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-ac170ef2-1df6-4aea-844b-ffcca27f950f tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:14.846720 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-ac170ef2-1df6-4aea-844b-ffcca27f950f tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1363 microversion: 2.1 time: 0.467488 Jul 29 05:22:14.847752 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 67/153] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:14 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1363 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:15.104115 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-c85adc3d-b4d5-48cd-955f-ea5da8861baf tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:15.104658 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-c85adc3d-b4d5-48cd-955f-ea5da8861baf tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:15.117823 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c85adc3d-b4d5-48cd-955f-ea5da8861baf tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:15.118084 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c85adc3d-b4d5-48cd-955f-ea5da8861baf tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:15.118873 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c85adc3d-b4d5-48cd-955f-ea5da8861baf tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:15.119306 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c85adc3d-b4d5-48cd-955f-ea5da8861baf tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:15.327553 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-b7e23633-9f82-4a38-80b0-2a574617d298 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:15.328733 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-b7e23633-9f82-4a38-80b0-2a574617d298 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:15.347931 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b7e23633-9f82-4a38-80b0-2a574617d298 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:15.348455 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b7e23633-9f82-4a38-80b0-2a574617d298 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:15.349252 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b7e23633-9f82-4a38-80b0-2a574617d298 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:15.349693 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b7e23633-9f82-4a38-80b0-2a574617d298 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:15.744739 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-c85adc3d-b4d5-48cd-955f-ea5da8861baf tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:15.758330 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-c85adc3d-b4d5-48cd-955f-ea5da8861baf tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:15.765177 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-c85adc3d-b4d5-48cd-955f-ea5da8861baf tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:15.768829 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-c85adc3d-b4d5-48cd-955f-ea5da8861baf tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1405 microversion: 2.20 time: 0.668915 Jul 29 05:22:15.771292 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 87/154] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:22:15 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1405 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:22:15.837273 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-b7e23633-9f82-4a38-80b0-2a574617d298 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:15.853550 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-b7e23633-9f82-4a38-80b0-2a574617d298 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1521 microversion: 2.1 time: 0.533033 Jul 29 05:22:15.855080 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 68/155] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:15 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1521 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:22:15.877629 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-7b1fde0d-f7ab-46a8-b7ec-942dd8f3601d tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:15.885903 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-7b1fde0d-f7ab-46a8-b7ec-942dd8f3601d tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:15.902916 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7b1fde0d-f7ab-46a8-b7ec-942dd8f3601d tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:15.903427 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7b1fde0d-f7ab-46a8-b7ec-942dd8f3601d tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:15.906016 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7b1fde0d-f7ab-46a8-b7ec-942dd8f3601d tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:15.908356 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7b1fde0d-f7ab-46a8-b7ec-942dd8f3601d tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:16.125637 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-7b1fde0d-f7ab-46a8-b7ec-942dd8f3601d tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:16.142744 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-7b1fde0d-f7ab-46a8-b7ec-942dd8f3601d tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1363 microversion: 2.1 time: 0.272210 Jul 29 05:22:16.160216 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 88/156] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:15 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1363 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:16.247325 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-ce4d5529-d724-4285-b2db-d61cc1cf5951 req-d9a1d408-405a-461f-bc7c-0f32e484e4b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6ff83e9-b98e-47c5-83cb-37ac61826fba", "name": "network-vif-plugged", "status": "completed", "tag": "271bc52d-2fba-4db9-bfaa-44a4a119f24e"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:22:16.267969 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-ce4d5529-d724-4285-b2db-d61cc1cf5951 req-d9a1d408-405a-461f-bc7c-0f32e484e4b2 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:16.268403 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-ce4d5529-d724-4285-b2db-d61cc1cf5951 req-d9a1d408-405a-461f-bc7c-0f32e484e4b2 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:16.299880 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-765628fb-419e-4ea8-b208-9dc3742580ca tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:16.300164 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-765628fb-419e-4ea8-b208-9dc3742580ca tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] [instance: 51207b24-620a-4479-be28-4db53ef4073e] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:16.302179 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-ce4d5529-d724-4285-b2db-d61cc1cf5951 req-d9a1d408-405a-461f-bc7c-0f32e484e4b2 service nova] Creating event network-vif-plugged:271bc52d-2fba-4db9-bfaa-44a4a119f24e for instance f6ff83e9-b98e-47c5-83cb-37ac61826fba on hv-cinder-85127 Jul 29 05:22:16.309432 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-765628fb-419e-4ea8-b208-9dc3742580ca tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:16.310287 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-765628fb-419e-4ea8-b208-9dc3742580ca tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:16.311276 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-765628fb-419e-4ea8-b208-9dc3742580ca tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:16.311968 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-765628fb-419e-4ea8-b208-9dc3742580ca tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:16.313166 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-ce4d5529-d724-4285-b2db-d61cc1cf5951 req-d9a1d408-405a-461f-bc7c-0f32e484e4b2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068731 Jul 29 05:22:16.316666 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 69/157] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:22:16.355249 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-765628fb-419e-4ea8-b208-9dc3742580ca tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] [instance: 51207b24-620a-4479-be28-4db53ef4073e] Going to try to terminate instance {{(pid=117821) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 05:22:16.660546 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-765628fb-419e-4ea8-b208-9dc3742580ca tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] 10.222.0.49 "DELETE /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e" status: 204 len: 0 microversion: 2.1 time: 0.365398 Jul 29 05:22:16.669833 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 89/158] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 05:22:16 2022] DELETE /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 05:22:16.684300 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-33a2aea0-77e3-4186-9793-33b52e976fc7 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:16.687490 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-33a2aea0-77e3-4186-9793-33b52e976fc7 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] [instance: 51207b24-620a-4479-be28-4db53ef4073e] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:16.700346 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-33a2aea0-77e3-4186-9793-33b52e976fc7 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:16.701625 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-33a2aea0-77e3-4186-9793-33b52e976fc7 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:16.702966 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-33a2aea0-77e3-4186-9793-33b52e976fc7 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:16.709529 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-33a2aea0-77e3-4186-9793-33b52e976fc7 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:16.806143 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-adf456e5-ecb8-4fbd-bce2-bd1a0f04e64b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:16.807387 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-adf456e5-ecb8-4fbd-bce2-bd1a0f04e64b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:16.816566 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-adf456e5-ecb8-4fbd-bce2-bd1a0f04e64b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:16.817428 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-adf456e5-ecb8-4fbd-bce2-bd1a0f04e64b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:16.818473 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-adf456e5-ecb8-4fbd-bce2-bd1a0f04e64b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:16.819585 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-adf456e5-ecb8-4fbd-bce2-bd1a0f04e64b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:16.959821 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-33a2aea0-77e3-4186-9793-33b52e976fc7 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720be309cbe14940873d774b06e91bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87396f5e6bf46f5b85720c8e365da81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:16.970128 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-33a2aea0-77e3-4186-9793-33b52e976fc7 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] 10.222.0.49 "GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e" status: 200 len: 1554 microversion: 2.1 time: 0.298764 Jul 29 05:22:16.970733 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 70/159] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:16 2022] GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e => generated 1554 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:16.979072 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-63c70e6f-fc25-4979-8672-a8a0cb7020b0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:16.980008 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-63c70e6f-fc25-4979-8672-a8a0cb7020b0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:16.989155 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-63c70e6f-fc25-4979-8672-a8a0cb7020b0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:16.989927 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-63c70e6f-fc25-4979-8672-a8a0cb7020b0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:16.990919 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-63c70e6f-fc25-4979-8672-a8a0cb7020b0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:16.991640 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-63c70e6f-fc25-4979-8672-a8a0cb7020b0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:17.073484 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-adf456e5-ecb8-4fbd-bce2-bd1a0f04e64b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:17.086117 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-adf456e5-ecb8-4fbd-bce2-bd1a0f04e64b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:17.090783 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-adf456e5-ecb8-4fbd-bce2-bd1a0f04e64b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:17.092256 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-adf456e5-ecb8-4fbd-bce2-bd1a0f04e64b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1405 microversion: 2.20 time: 0.297298 Jul 29 05:22:17.107462 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 90/160] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:22:16 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1405 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:22:17.194059 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-033e4a47-0173-4ec1-9b46-6e156ba10d7c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:17.209234 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-033e4a47-0173-4ec1-9b46-6e156ba10d7c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:17.220990 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-033e4a47-0173-4ec1-9b46-6e156ba10d7c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:17.222077 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-033e4a47-0173-4ec1-9b46-6e156ba10d7c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:17.223795 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-033e4a47-0173-4ec1-9b46-6e156ba10d7c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:17.225713 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-033e4a47-0173-4ec1-9b46-6e156ba10d7c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:17.355313 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-63c70e6f-fc25-4979-8672-a8a0cb7020b0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:17.387891 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-63c70e6f-fc25-4979-8672-a8a0cb7020b0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1521 microversion: 2.1 time: 0.412257 Jul 29 05:22:17.392094 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 71/161] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:16 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1521 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:17.584160 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-033e4a47-0173-4ec1-9b46-6e156ba10d7c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:17.598321 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-033e4a47-0173-4ec1-9b46-6e156ba10d7c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1363 microversion: 2.1 time: 0.412802 Jul 29 05:22:17.599397 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 91/162] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:17 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1363 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:18.023869 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-ac565aa3-a9f0-4b42-aae9-62a256a36092 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:18.023869 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-ac565aa3-a9f0-4b42-aae9-62a256a36092 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] [instance: 51207b24-620a-4479-be28-4db53ef4073e] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:18.035045 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ac565aa3-a9f0-4b42-aae9-62a256a36092 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:18.036160 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ac565aa3-a9f0-4b42-aae9-62a256a36092 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:18.037502 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ac565aa3-a9f0-4b42-aae9-62a256a36092 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:18.038138 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ac565aa3-a9f0-4b42-aae9-62a256a36092 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:18.123017 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-d2188ab7-2781-46e7-a494-a2a99fdd3bdc tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:18.125608 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-d2188ab7-2781-46e7-a494-a2a99fdd3bdc tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:18.139257 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d2188ab7-2781-46e7-a494-a2a99fdd3bdc tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:18.140125 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d2188ab7-2781-46e7-a494-a2a99fdd3bdc tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:18.142217 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d2188ab7-2781-46e7-a494-a2a99fdd3bdc tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:18.143517 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d2188ab7-2781-46e7-a494-a2a99fdd3bdc tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:18.286895 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-ac565aa3-a9f0-4b42-aae9-62a256a36092 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720be309cbe14940873d774b06e91bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87396f5e6bf46f5b85720c8e365da81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:18.301144 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-ac565aa3-a9f0-4b42-aae9-62a256a36092 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] 10.222.0.49 "GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e" status: 200 len: 1554 microversion: 2.1 time: 0.290292 Jul 29 05:22:18.302390 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 72/163] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:18 2022] GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e => generated 1554 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:18.336908 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-37e2b47d-3931-43a1-aac0-4b3d60518edc req-b4a2478b-00e2-4f33-a9f4-07ebd1dcf0af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ff4221e-eadc-491b-9f3c-9b41413a63d0", "name": "network-vif-plugged", "status": "completed", "tag": "de35419f-6c42-424f-baf0-e88731e69e60"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:22:18.354498 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-37e2b47d-3931-43a1-aac0-4b3d60518edc req-b4a2478b-00e2-4f33-a9f4-07ebd1dcf0af service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:18.356025 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-37e2b47d-3931-43a1-aac0-4b3d60518edc req-b4a2478b-00e2-4f33-a9f4-07ebd1dcf0af service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:18.398799 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-37e2b47d-3931-43a1-aac0-4b3d60518edc req-b4a2478b-00e2-4f33-a9f4-07ebd1dcf0af service nova] Creating event network-vif-plugged:de35419f-6c42-424f-baf0-e88731e69e60 for instance 6ff4221e-eadc-491b-9f3c-9b41413a63d0 on hv-cinder-85127 Jul 29 05:22:18.405096 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-37e2b47d-3931-43a1-aac0-4b3d60518edc req-b4a2478b-00e2-4f33-a9f4-07ebd1dcf0af service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074305 Jul 29 05:22:18.406396 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 73/164] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:22:18.414746 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-bfe31793-c7d0-4268-bac7-3fb1b0b0356b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:18.415662 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-bfe31793-c7d0-4268-bac7-3fb1b0b0356b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:18.424271 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bfe31793-c7d0-4268-bac7-3fb1b0b0356b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:18.424942 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bfe31793-c7d0-4268-bac7-3fb1b0b0356b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:18.425930 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bfe31793-c7d0-4268-bac7-3fb1b0b0356b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:18.426526 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bfe31793-c7d0-4268-bac7-3fb1b0b0356b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:18.506964 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-d2188ab7-2781-46e7-a494-a2a99fdd3bdc tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:18.534956 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-d2188ab7-2781-46e7-a494-a2a99fdd3bdc tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:18.538159 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-d2188ab7-2781-46e7-a494-a2a99fdd3bdc tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:18.539796 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-d2188ab7-2781-46e7-a494-a2a99fdd3bdc tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1405 microversion: 2.20 time: 0.424123 Jul 29 05:22:18.540633 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 92/165] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:22:18 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1405 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:22:18.624707 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-6487872f-c28b-44a5-8ced-c88e4d34bccc tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:18.626856 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-6487872f-c28b-44a5-8ced-c88e4d34bccc tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:18.640213 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6487872f-c28b-44a5-8ced-c88e4d34bccc tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:18.642175 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6487872f-c28b-44a5-8ced-c88e4d34bccc tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:18.644706 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6487872f-c28b-44a5-8ced-c88e4d34bccc tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:18.646020 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6487872f-c28b-44a5-8ced-c88e4d34bccc tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:18.682402 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-bfe31793-c7d0-4268-bac7-3fb1b0b0356b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:18.693960 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-bfe31793-c7d0-4268-bac7-3fb1b0b0356b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1521 microversion: 2.1 time: 0.285127 Jul 29 05:22:18.695018 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 74/166] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:18 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:18.959759 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-6487872f-c28b-44a5-8ced-c88e4d34bccc tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:18.979828 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-6487872f-c28b-44a5-8ced-c88e4d34bccc tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1363 microversion: 2.1 time: 0.358830 Jul 29 05:22:18.980731 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 93/167] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:18 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1363 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:19.337947 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-552339cb-0d33-4fc4-8fee-330ee3e37f54 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:19.338769 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-552339cb-0d33-4fc4-8fee-330ee3e37f54 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] [instance: 51207b24-620a-4479-be28-4db53ef4073e] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:19.346892 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-552339cb-0d33-4fc4-8fee-330ee3e37f54 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:19.347678 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-552339cb-0d33-4fc4-8fee-330ee3e37f54 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:19.348624 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-552339cb-0d33-4fc4-8fee-330ee3e37f54 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:19.349222 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-552339cb-0d33-4fc4-8fee-330ee3e37f54 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:19.568991 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-c4bf083c-cf1c-4c33-b258-956477502d46 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:19.569917 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-c4bf083c-cf1c-4c33-b258-956477502d46 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:19.589657 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c4bf083c-cf1c-4c33-b258-956477502d46 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:19.601862 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c4bf083c-cf1c-4c33-b258-956477502d46 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:19.603332 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c4bf083c-cf1c-4c33-b258-956477502d46 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:19.604347 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c4bf083c-cf1c-4c33-b258-956477502d46 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:19.708852 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-552339cb-0d33-4fc4-8fee-330ee3e37f54 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720be309cbe14940873d774b06e91bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87396f5e6bf46f5b85720c8e365da81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:19.731041 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-552339cb-0d33-4fc4-8fee-330ee3e37f54 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] 10.222.0.49 "GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e" status: 200 len: 1554 microversion: 2.1 time: 0.396442 Jul 29 05:22:19.747509 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 75/168] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:19 2022] GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e => generated 1554 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:19.764387 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-92304158-cd30-4a73-978a-cc9d00331c89 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:19.765480 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-92304158-cd30-4a73-978a-cc9d00331c89 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:19.791845 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-92304158-cd30-4a73-978a-cc9d00331c89 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:19.792599 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-92304158-cd30-4a73-978a-cc9d00331c89 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:19.797355 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-92304158-cd30-4a73-978a-cc9d00331c89 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:19.802449 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-92304158-cd30-4a73-978a-cc9d00331c89 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:19.971153 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-c4bf083c-cf1c-4c33-b258-956477502d46 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:19.995792 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-c4bf083c-cf1c-4c33-b258-956477502d46 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:20.010722 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-c4bf083c-cf1c-4c33-b258-956477502d46 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:20.011969 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-c4bf083c-cf1c-4c33-b258-956477502d46 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1405 microversion: 2.20 time: 0.451164 Jul 29 05:22:20.012560 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 94/169] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:22:19 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1405 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:22:20.024647 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-593a4eaa-a796-44f8-bd07-079bc6ea5e8c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:20.027571 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-593a4eaa-a796-44f8-bd07-079bc6ea5e8c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:20.042423 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-593a4eaa-a796-44f8-bd07-079bc6ea5e8c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:20.042883 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-593a4eaa-a796-44f8-bd07-079bc6ea5e8c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:20.043746 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-593a4eaa-a796-44f8-bd07-079bc6ea5e8c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:20.044189 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-593a4eaa-a796-44f8-bd07-079bc6ea5e8c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:20.368643 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-92304158-cd30-4a73-978a-cc9d00331c89 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:20.386307 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-92304158-cd30-4a73-978a-cc9d00331c89 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1521 microversion: 2.1 time: 0.642340 Jul 29 05:22:20.387321 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 76/170] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:19 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1521 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:20.425406 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-593a4eaa-a796-44f8-bd07-079bc6ea5e8c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:20.442076 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-593a4eaa-a796-44f8-bd07-079bc6ea5e8c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1363 microversion: 2.1 time: 0.427850 Jul 29 05:22:20.444079 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 95/171] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:20 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1363 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:20.770214 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-95c79737-2b86-4a87-b737-4b9c375541be tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:20.770847 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-95c79737-2b86-4a87-b737-4b9c375541be tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] [instance: 51207b24-620a-4479-be28-4db53ef4073e] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:20.786195 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-95c79737-2b86-4a87-b737-4b9c375541be tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:20.787797 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-95c79737-2b86-4a87-b737-4b9c375541be tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:20.790504 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-95c79737-2b86-4a87-b737-4b9c375541be tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:20.794112 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-95c79737-2b86-4a87-b737-4b9c375541be tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:21.052577 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-7c99ea28-b216-4145-8edb-ea3550b30bd2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:21.053743 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-7c99ea28-b216-4145-8edb-ea3550b30bd2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:21.061492 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7c99ea28-b216-4145-8edb-ea3550b30bd2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:21.062034 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7c99ea28-b216-4145-8edb-ea3550b30bd2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:21.062895 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7c99ea28-b216-4145-8edb-ea3550b30bd2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:21.064035 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7c99ea28-b216-4145-8edb-ea3550b30bd2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:21.171404 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-95c79737-2b86-4a87-b737-4b9c375541be tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720be309cbe14940873d774b06e91bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87396f5e6bf46f5b85720c8e365da81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:21.176355 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell1:SELECT=100 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:22:21.183990 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-95c79737-2b86-4a87-b737-4b9c375541be tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] 10.222.0.49 "GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e" status: 200 len: 1554 microversion: 2.1 time: 0.418903 Jul 29 05:22:21.199620 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 77/172] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:20 2022] GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e => generated 1554 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:21.282918 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-7c99ea28-b216-4145-8edb-ea3550b30bd2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:21.292919 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-7c99ea28-b216-4145-8edb-ea3550b30bd2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:21.294614 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-7c99ea28-b216-4145-8edb-ea3550b30bd2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:21.295942 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-7c99ea28-b216-4145-8edb-ea3550b30bd2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1405 microversion: 2.20 time: 0.249397 Jul 29 05:22:21.311233 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 96/173] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:22:21 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1405 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:22:21.410468 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-1716b79e-bd1e-4022-b9df-c6ea6a0a1e7c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:21.413328 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-1716b79e-bd1e-4022-b9df-c6ea6a0a1e7c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:21.424261 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1716b79e-bd1e-4022-b9df-c6ea6a0a1e7c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:21.424417 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1716b79e-bd1e-4022-b9df-c6ea6a0a1e7c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:21.425376 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1716b79e-bd1e-4022-b9df-c6ea6a0a1e7c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:21.426620 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1716b79e-bd1e-4022-b9df-c6ea6a0a1e7c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:21.490976 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-4752e651-39a6-4559-b263-eeb2f832b99a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:21.504235 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-4752e651-39a6-4559-b263-eeb2f832b99a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:21.518091 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4752e651-39a6-4559-b263-eeb2f832b99a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:21.521768 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4752e651-39a6-4559-b263-eeb2f832b99a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:21.525115 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4752e651-39a6-4559-b263-eeb2f832b99a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:21.526753 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4752e651-39a6-4559-b263-eeb2f832b99a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:21.678106 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-1716b79e-bd1e-4022-b9df-c6ea6a0a1e7c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:21.691112 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-1716b79e-bd1e-4022-b9df-c6ea6a0a1e7c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1521 microversion: 2.1 time: 0.285694 Jul 29 05:22:21.691763 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 78/174] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:21 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:22:21.696756 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-f5210cfa-4bb0-4513-86fe-950128630d25 req-e6f8584a-da5b-49eb-8c72-9ae63a181797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51207b24-620a-4479-be28-4db53ef4073e", "name": "network-vif-deleted", "tag": "d7a5be9c-7f6e-42cf-b431-44dea7fa4b46"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:22:21.708537 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-f5210cfa-4bb0-4513-86fe-950128630d25 req-e6f8584a-da5b-49eb-8c72-9ae63a181797 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:21.709382 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-f5210cfa-4bb0-4513-86fe-950128630d25 req-e6f8584a-da5b-49eb-8c72-9ae63a181797 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:21.724818 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-f5210cfa-4bb0-4513-86fe-950128630d25 req-e6f8584a-da5b-49eb-8c72-9ae63a181797 service nova] Creating event network-vif-deleted:d7a5be9c-7f6e-42cf-b431-44dea7fa4b46 for instance 51207b24-620a-4479-be28-4db53ef4073e on hv-cinder-85127 Jul 29 05:22:21.730134 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-f5210cfa-4bb0-4513-86fe-950128630d25 req-e6f8584a-da5b-49eb-8c72-9ae63a181797 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036880 Jul 29 05:22:21.730753 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 79/175] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:22:21.786748 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-4752e651-39a6-4559-b263-eeb2f832b99a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:21.799590 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-4752e651-39a6-4559-b263-eeb2f832b99a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1549 microversion: 2.1 time: 0.319538 Jul 29 05:22:21.800765 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 97/176] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:21 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1549 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:21.840091 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-8cecc83b-10c3-465b-9bcd-3ee06d6cef78 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:21.841725 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-8cecc83b-10c3-465b-9bcd-3ee06d6cef78 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:21.859277 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8cecc83b-10c3-465b-9bcd-3ee06d6cef78 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:21.863129 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8cecc83b-10c3-465b-9bcd-3ee06d6cef78 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:21.866903 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8cecc83b-10c3-465b-9bcd-3ee06d6cef78 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:21.868038 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8cecc83b-10c3-465b-9bcd-3ee06d6cef78 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:22.064555 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-8cecc83b-10c3-465b-9bcd-3ee06d6cef78 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.244436 Jul 29 05:22:22.065342 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 80/177] 10.222.0.49 () {58 vars in 1275 bytes} [Fri Jul 29 05:22:21 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba/os-interface => generated 285 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:22:22.213655 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-7780361b-fce3-44b9-8483-16ab4e39aa64 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:22.216400 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-7780361b-fce3-44b9-8483-16ab4e39aa64 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] [instance: 51207b24-620a-4479-be28-4db53ef4073e] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:22.243220 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7780361b-fce3-44b9-8483-16ab4e39aa64 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:22.243966 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7780361b-fce3-44b9-8483-16ab4e39aa64 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:22.245440 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7780361b-fce3-44b9-8483-16ab4e39aa64 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:22.246548 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7780361b-fce3-44b9-8483-16ab4e39aa64 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:22.318780 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-3eada8a0-ee79-41f5-bed1-795bec2003d8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:22.319742 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-3eada8a0-ee79-41f5-bed1-795bec2003d8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:22.329805 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3eada8a0-ee79-41f5-bed1-795bec2003d8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:22.330631 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3eada8a0-ee79-41f5-bed1-795bec2003d8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:22.331732 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3eada8a0-ee79-41f5-bed1-795bec2003d8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:22.342264 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3eada8a0-ee79-41f5-bed1-795bec2003d8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:22.373200 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-7780361b-fce3-44b9-8483-16ab4e39aa64 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720be309cbe14940873d774b06e91bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87396f5e6bf46f5b85720c8e365da81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:22.386873 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-7780361b-fce3-44b9-8483-16ab4e39aa64 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] 10.222.0.49 "GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e" status: 200 len: 1345 microversion: 2.1 time: 0.179712 Jul 29 05:22:22.399659 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 98/178] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:22 2022] GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e => generated 1345 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:22:22.684971 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-3eada8a0-ee79-41f5-bed1-795bec2003d8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:22.692735 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-3eada8a0-ee79-41f5-bed1-795bec2003d8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:22.696031 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-3eada8a0-ee79-41f5-bed1-795bec2003d8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:22.697538 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-3eada8a0-ee79-41f5-bed1-795bec2003d8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1597 microversion: 2.20 time: 0.382692 Jul 29 05:22:22.698436 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 81/179] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:22:22 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1597 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:22:22.713255 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-8aa89187-e49f-40e8-884e-f6826bb69b90 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:22.714624 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-8aa89187-e49f-40e8-884e-f6826bb69b90 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:22.722741 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8aa89187-e49f-40e8-884e-f6826bb69b90 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:22.723589 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8aa89187-e49f-40e8-884e-f6826bb69b90 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:22.724766 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8aa89187-e49f-40e8-884e-f6826bb69b90 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:22.725408 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8aa89187-e49f-40e8-884e-f6826bb69b90 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:22.726609 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-ecb0226b-5014-48d6-a89f-1e9ed03d2701 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:22.727168 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-ecb0226b-5014-48d6-a89f-1e9ed03d2701 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:22.749915 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ecb0226b-5014-48d6-a89f-1e9ed03d2701 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:22.750368 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ecb0226b-5014-48d6-a89f-1e9ed03d2701 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:22.755407 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ecb0226b-5014-48d6-a89f-1e9ed03d2701 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:22.755879 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ecb0226b-5014-48d6-a89f-1e9ed03d2701 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:22.983980 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-8aa89187-e49f-40e8-884e-f6826bb69b90 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:22.995727 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-8aa89187-e49f-40e8-884e-f6826bb69b90 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1521 microversion: 2.1 time: 0.286212 Jul 29 05:22:22.997842 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 99/180] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:22 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:23.087623 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-ecb0226b-5014-48d6-a89f-1e9ed03d2701 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.367446 Jul 29 05:22:23.090480 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 82/181] 10.222.0.49 () {60 vars in 1316 bytes} [Fri Jul 29 05:22:22 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0/os-interface => generated 285 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 05:22:23.419882 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-d64f9bd9-be13-4e94-9a0f-85b74d6aa15a tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:23.421011 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-d64f9bd9-be13-4e94-9a0f-85b74d6aa15a tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] [instance: 51207b24-620a-4479-be28-4db53ef4073e] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:23.461902 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d64f9bd9-be13-4e94-9a0f-85b74d6aa15a tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:23.465052 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d64f9bd9-be13-4e94-9a0f-85b74d6aa15a tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:23.469725 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d64f9bd9-be13-4e94-9a0f-85b74d6aa15a tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:23.473498 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d64f9bd9-be13-4e94-9a0f-85b74d6aa15a tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:23.566474 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:22:23.601300 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d64f9bd9-be13-4e94-9a0f-85b74d6aa15a tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:23.605035 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d64f9bd9-be13-4e94-9a0f-85b74d6aa15a tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:23.606407 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.objects.instance [None req-d64f9bd9-be13-4e94-9a0f-85b74d6aa15a tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lazy-loading 'fault' on Instance uuid 51207b24-620a-4479-be28-4db53ef4073e {{(pid=117821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:22:23.816375 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-d64f9bd9-be13-4e94-9a0f-85b74d6aa15a tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720be309cbe14940873d774b06e91bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87396f5e6bf46f5b85720c8e365da81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:23.856725 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-d64f9bd9-be13-4e94-9a0f-85b74d6aa15a tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] 10.222.0.49 "GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e" status: 200 len: 1304 microversion: 2.1 time: 0.437832 Jul 29 05:22:23.871424 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 100/182] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:23 2022] GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e => generated 1304 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:24.049179 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-82c3ca10-a3d7-42dd-ad80-a7feb3138eef tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:24.052363 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-82c3ca10-a3d7-42dd-ad80-a7feb3138eef tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:24.082349 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-82c3ca10-a3d7-42dd-ad80-a7feb3138eef tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:24.083169 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-82c3ca10-a3d7-42dd-ad80-a7feb3138eef tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:24.084936 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-82c3ca10-a3d7-42dd-ad80-a7feb3138eef tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:24.089203 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-82c3ca10-a3d7-42dd-ad80-a7feb3138eef tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:24.472242 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-82c3ca10-a3d7-42dd-ad80-a7feb3138eef tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:24.488173 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-82c3ca10-a3d7-42dd-ad80-a7feb3138eef tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1521 microversion: 2.1 time: 0.446257 Jul 29 05:22:24.501927 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 83/183] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:24 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1521 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:22:24.870024 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-ae1e2cdd-cd67-40f5-9f5d-6bf4f8a3f8df req-5bb1224f-17dd-4cb7-ab7a-da366d26016e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6ff83e9-b98e-47c5-83cb-37ac61826fba", "tag": "271bc52d-2fba-4db9-bfaa-44a4a119f24e"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:22:24.892216 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-ae1e2cdd-cd67-40f5-9f5d-6bf4f8a3f8df req-5bb1224f-17dd-4cb7-ab7a-da366d26016e service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:24.893377 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-ae1e2cdd-cd67-40f5-9f5d-6bf4f8a3f8df req-5bb1224f-17dd-4cb7-ab7a-da366d26016e service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:24.906173 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-b2ef79bb-5f01-4991-b4ff-84a3f5b7bf7c tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:24.911540 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-b2ef79bb-5f01-4991-b4ff-84a3f5b7bf7c tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] [instance: 51207b24-620a-4479-be28-4db53ef4073e] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:24.917291 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-ae1e2cdd-cd67-40f5-9f5d-6bf4f8a3f8df req-5bb1224f-17dd-4cb7-ab7a-da366d26016e service nova] Creating event network-changed:271bc52d-2fba-4db9-bfaa-44a4a119f24e for instance f6ff83e9-b98e-47c5-83cb-37ac61826fba on hv-cinder-85127 Jul 29 05:22:24.926771 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-ae1e2cdd-cd67-40f5-9f5d-6bf4f8a3f8df req-5bb1224f-17dd-4cb7-ab7a-da366d26016e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062300 Jul 29 05:22:24.933502 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 101/184] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:22:24.960356 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b2ef79bb-5f01-4991-b4ff-84a3f5b7bf7c tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:24.962065 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b2ef79bb-5f01-4991-b4ff-84a3f5b7bf7c tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:24.964846 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b2ef79bb-5f01-4991-b4ff-84a3f5b7bf7c tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:24.966625 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b2ef79bb-5f01-4991-b4ff-84a3f5b7bf7c tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:25.028713 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.wsgi [None req-b2ef79bb-5f01-4991-b4ff-84a3f5b7bf7c tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] HTTP exception thrown: Instance 51207b24-620a-4479-be28-4db53ef4073e could not be found. Jul 29 05:22:25.048220 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-b2ef79bb-5f01-4991-b4ff-84a3f5b7bf7c tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Request method failure captured: Jul 29 05:22:25.048220 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: request: GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e HTTP/1.1 Jul 29 05:22:25.048220 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept: application/json Jul 29 05:22:25.048220 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept-Encoding: identity Jul 29 05:22:25.048220 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Connection: close Jul 29 05:22:25.048220 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Length: 0 Jul 29 05:22:25.048220 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Type: application/json Jul 29 05:22:25.048220 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Host: 10.222.0.49 Jul 29 05:22:25.048220 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Openstack-System-Scope: None Jul 29 05:22:25.048220 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: User-Agent: python-urllib3/1.26.10 Jul 29 05:22:25.048220 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Auth-Token: gAAAAABi425Q5VJDrJAfdS5zYTBjP4ep4qqYIxmbMAGJcnaIdi1dkbCyDOx2kYBKGudkg1oYqyo3ToYin7mmGSZg_Smn56-cghjTrMBRePlaC6PcQ2p50vl0510TLIjYAamr-JAa0CrobhwxMJET50xypa5e7SJAxz435beKSabURsmLZM6UfPc Jul 29 05:22:25.048220 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Id: None Jul 29 05:22:25.048220 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Name: None Jul 29 05:22:25.048220 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Identity-Status: Confirmed Jul 29 05:22:25.048220 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Is-Admin-Project: True Jul 29 05:22:25.048220 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Id: default Jul 29 05:22:25.048220 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Name: Default Jul 29 05:22:25.048220 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Id: c87396f5e6bf46f5b85720c8e365da81 Jul 29 05:22:25.048220 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Name: tempest-DeleteServersTestJSON-433700856 Jul 29 05:22:25.048220 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Role: member,reader Jul 29 05:22:25.048220 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Roles: member,reader Jul 29 05:22:25.050344 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c87396f5e6bf46f5b85720c8e365da81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c87396f5e6bf46f5b85720c8e365da81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c87396f5e6bf46f5b85720c8e365da81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c87396f5e6bf46f5b85720c8e365da81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:22:25.050344 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant: tempest-DeleteServersTestJSON-433700856 Jul 29 05:22:25.050344 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Id: c87396f5e6bf46f5b85720c8e365da81 Jul 29 05:22:25.050344 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Name: tempest-DeleteServersTestJSON-433700856 Jul 29 05:22:25.050344 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User: tempest-DeleteServersTestJSON-433700856-project Jul 29 05:22:25.050344 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Id: default Jul 29 05:22:25.050344 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Name: Default Jul 29 05:22:25.050344 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Id: 720be309cbe14940873d774b06e91bf9 Jul 29 05:22:25.050344 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Name: tempest-DeleteServersTestJSON-433700856-project Jul 29 05:22:25.050344 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: method: > Jul 29 05:22:25.050344 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: exception: Instance 51207b24-620a-4479-be28-4db53ef4073e could not be found. Jul 29 05:22:25.050344 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: action_args: {'id': '51207b24-620a-4479-be28-4db53ef4073e'} Jul 29 05:22:25.051062 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:22:25.051062 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:22:25.051062 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:22:25.051062 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:22:25.051062 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:22:25.051062 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:22:25.051062 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:22:25.051062 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:22:25.051062 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:22:25.051062 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:22:25.051062 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51207b24-620a-4479-be28-4db53ef4073e could not be found. Jul 29 05:22:25.051062 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:22:25.051062 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:22:25.051062 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:22:25.051062 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:22:25.051062 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:22:25.051062 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:22:25.051062 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:22:25.051062 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:22:25.051062 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:22:25.052245 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:22:25.052245 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:22:25.052245 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:22:25.052245 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:22:25.052245 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:22:25.052245 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:22:25.052245 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:22:25.052245 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51207b24-620a-4479-be28-4db53ef4073e could not be found. Jul 29 05:22:25.052245 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:22:25.052245 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:22:25.052245 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:22:25.052245 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:22:25.052245 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:22:25.052245 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:22:25.052245 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:22:25.052245 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:22:25.052245 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51207b24-620a-4479-be28-4db53ef4073e could not be found. Jul 29 05:22:25.052245 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:22:25.053427 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-b2ef79bb-5f01-4991-b4ff-84a3f5b7bf7c tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Returning 404 to user: Instance 51207b24-620a-4479-be28-4db53ef4073e could not be found. {{(pid=117820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:22:25.053427 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-b2ef79bb-5f01-4991-b4ff-84a3f5b7bf7c tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] 10.222.0.49 "GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e" status: 404 len: 111 microversion: 2.1 time: 0.156406 Jul 29 05:22:25.055158 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 84/185] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:24 2022] GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:22:25.317430 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-30f0be09-8c9b-493c-a870-359e4ffcb965 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:25.321215 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-30f0be09-8c9b-493c-a870-359e4ffcb965 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] [instance: 51207b24-620a-4479-be28-4db53ef4073e] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:25.338547 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-30f0be09-8c9b-493c-a870-359e4ffcb965 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:25.341686 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-30f0be09-8c9b-493c-a870-359e4ffcb965 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:25.342867 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-30f0be09-8c9b-493c-a870-359e4ffcb965 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:25.344785 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-30f0be09-8c9b-493c-a870-359e4ffcb965 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:25.390553 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.wsgi [None req-30f0be09-8c9b-493c-a870-359e4ffcb965 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] HTTP exception thrown: Instance 51207b24-620a-4479-be28-4db53ef4073e could not be found. Jul 29 05:22:25.405447 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-30f0be09-8c9b-493c-a870-359e4ffcb965 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Request method failure captured: Jul 29 05:22:25.405447 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: request: GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e/os-volume_attachments HTTP/1.1 Jul 29 05:22:25.405447 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept: application/json Jul 29 05:22:25.405447 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept-Encoding: identity Jul 29 05:22:25.405447 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Connection: close Jul 29 05:22:25.405447 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Length: 0 Jul 29 05:22:25.405447 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Type: application/json Jul 29 05:22:25.405447 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Host: 10.222.0.49 Jul 29 05:22:25.405447 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Openstack-System-Scope: None Jul 29 05:22:25.405447 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: User-Agent: python-urllib3/1.26.10 Jul 29 05:22:25.405447 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Auth-Token: gAAAAABi425Q5VJDrJAfdS5zYTBjP4ep4qqYIxmbMAGJcnaIdi1dkbCyDOx2kYBKGudkg1oYqyo3ToYin7mmGSZg_Smn56-cghjTrMBRePlaC6PcQ2p50vl0510TLIjYAamr-JAa0CrobhwxMJET50xypa5e7SJAxz435beKSabURsmLZM6UfPc Jul 29 05:22:25.405447 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Id: None Jul 29 05:22:25.405447 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Name: None Jul 29 05:22:25.405447 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Identity-Status: Confirmed Jul 29 05:22:25.405447 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Is-Admin-Project: True Jul 29 05:22:25.405447 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Id: default Jul 29 05:22:25.405447 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Name: Default Jul 29 05:22:25.405447 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Id: c87396f5e6bf46f5b85720c8e365da81 Jul 29 05:22:25.405447 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Name: tempest-DeleteServersTestJSON-433700856 Jul 29 05:22:25.405447 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Role: member,reader Jul 29 05:22:25.405447 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Roles: member,reader Jul 29 05:22:25.406748 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c87396f5e6bf46f5b85720c8e365da81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c87396f5e6bf46f5b85720c8e365da81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c87396f5e6bf46f5b85720c8e365da81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c87396f5e6bf46f5b85720c8e365da81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:22:25.406748 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant: tempest-DeleteServersTestJSON-433700856 Jul 29 05:22:25.406748 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Id: c87396f5e6bf46f5b85720c8e365da81 Jul 29 05:22:25.406748 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Name: tempest-DeleteServersTestJSON-433700856 Jul 29 05:22:25.406748 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User: tempest-DeleteServersTestJSON-433700856-project Jul 29 05:22:25.406748 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Id: default Jul 29 05:22:25.406748 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Name: Default Jul 29 05:22:25.406748 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Id: 720be309cbe14940873d774b06e91bf9 Jul 29 05:22:25.406748 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Name: tempest-DeleteServersTestJSON-433700856-project Jul 29 05:22:25.406748 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: method: > Jul 29 05:22:25.406748 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: exception: Instance 51207b24-620a-4479-be28-4db53ef4073e could not be found. Jul 29 05:22:25.406748 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: action_args: {'server_id': '51207b24-620a-4479-be28-4db53ef4073e'} Jul 29 05:22:25.407484 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:22:25.407484 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:22:25.407484 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:22:25.407484 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:22:25.407484 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:22:25.407484 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:22:25.407484 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:22:25.407484 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:22:25.407484 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:22:25.407484 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:22:25.407484 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51207b24-620a-4479-be28-4db53ef4073e could not be found. Jul 29 05:22:25.407484 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:22:25.407484 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:22:25.407484 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:22:25.407484 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:22:25.407484 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:22:25.407484 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:22:25.407484 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:22:25.407484 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:22:25.407484 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:22:25.408775 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:22:25.408775 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 29 05:22:25.408775 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 05:22:25.408775 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 29 05:22:25.408775 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 05:22:25.408775 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 29 05:22:25.408775 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 29 05:22:25.408775 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:22:25.408775 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:22:25.408775 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51207b24-620a-4479-be28-4db53ef4073e could not be found. Jul 29 05:22:25.408775 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:22:25.408775 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:22:25.408775 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:22:25.408775 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:22:25.408775 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:22:25.408775 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:22:25.408775 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:22:25.408775 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:22:25.408775 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51207b24-620a-4479-be28-4db53ef4073e could not be found. Jul 29 05:22:25.408775 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:22:25.412286 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-30f0be09-8c9b-493c-a870-359e4ffcb965 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Returning 404 to user: Instance 51207b24-620a-4479-be28-4db53ef4073e could not be found. {{(pid=117821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:22:25.413683 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-30f0be09-8c9b-493c-a870-359e4ffcb965 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] 10.222.0.49 "GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.108884 Jul 29 05:22:25.414832 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 102/186] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:22:25 2022] GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e/os-volume_attachments => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:22:25.538014 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-c7b2e64b-6e2d-4090-8988-b40c88dedb1d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:25.544037 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-c7b2e64b-6e2d-4090-8988-b40c88dedb1d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:25.565471 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c7b2e64b-6e2d-4090-8988-b40c88dedb1d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:25.566329 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c7b2e64b-6e2d-4090-8988-b40c88dedb1d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:25.567451 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c7b2e64b-6e2d-4090-8988-b40c88dedb1d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:25.575630 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c7b2e64b-6e2d-4090-8988-b40c88dedb1d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:25.801662 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-5fee179d-7e94-44ed-9b69-3c05988b0c01 req-a658e766-0234-4624-9a74-32aa5aab624f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ff4221e-eadc-491b-9f3c-9b41413a63d0", "tag": "de35419f-6c42-424f-baf0-e88731e69e60"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:22:25.822079 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-5fee179d-7e94-44ed-9b69-3c05988b0c01 req-a658e766-0234-4624-9a74-32aa5aab624f service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:25.823615 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-5fee179d-7e94-44ed-9b69-3c05988b0c01 req-a658e766-0234-4624-9a74-32aa5aab624f service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:25.853318 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-5fee179d-7e94-44ed-9b69-3c05988b0c01 req-a658e766-0234-4624-9a74-32aa5aab624f service nova] Creating event network-changed:de35419f-6c42-424f-baf0-e88731e69e60 for instance 6ff4221e-eadc-491b-9f3c-9b41413a63d0 on hv-cinder-85127 Jul 29 05:22:25.866810 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-5fee179d-7e94-44ed-9b69-3c05988b0c01 req-a658e766-0234-4624-9a74-32aa5aab624f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069272 Jul 29 05:22:25.871088 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 103/187] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:22:26.257689 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-c7b2e64b-6e2d-4090-8988-b40c88dedb1d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:26.271907 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-c7b2e64b-6e2d-4090-8988-b40c88dedb1d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1521 microversion: 2.1 time: 0.747355 Jul 29 05:22:26.272528 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 85/188] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:25 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1521 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:26.784884 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-d665466d-c5ce-4661-a7ae-c29ea62a0598 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:26.785699 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-d665466d-c5ce-4661-a7ae-c29ea62a0598 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] [instance: 51207b24-620a-4479-be28-4db53ef4073e] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:26.810645 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d665466d-c5ce-4661-a7ae-c29ea62a0598 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:26.818880 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d665466d-c5ce-4661-a7ae-c29ea62a0598 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:26.820307 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d665466d-c5ce-4661-a7ae-c29ea62a0598 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:26.829374 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d665466d-c5ce-4661-a7ae-c29ea62a0598 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:26.870678 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.wsgi [None req-d665466d-c5ce-4661-a7ae-c29ea62a0598 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] HTTP exception thrown: Instance 51207b24-620a-4479-be28-4db53ef4073e could not be found. Jul 29 05:22:26.874653 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-d665466d-c5ce-4661-a7ae-c29ea62a0598 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Request method failure captured: Jul 29 05:22:26.874653 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: request: DELETE /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e HTTP/1.1 Jul 29 05:22:26.874653 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept: application/json Jul 29 05:22:26.874653 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept-Encoding: identity Jul 29 05:22:26.874653 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Connection: close Jul 29 05:22:26.874653 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Length: 0 Jul 29 05:22:26.874653 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Type: application/json Jul 29 05:22:26.874653 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Host: 10.222.0.49 Jul 29 05:22:26.874653 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Openstack-System-Scope: None Jul 29 05:22:26.874653 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: User-Agent: python-urllib3/1.26.10 Jul 29 05:22:26.874653 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Auth-Token: gAAAAABi425Q5VJDrJAfdS5zYTBjP4ep4qqYIxmbMAGJcnaIdi1dkbCyDOx2kYBKGudkg1oYqyo3ToYin7mmGSZg_Smn56-cghjTrMBRePlaC6PcQ2p50vl0510TLIjYAamr-JAa0CrobhwxMJET50xypa5e7SJAxz435beKSabURsmLZM6UfPc Jul 29 05:22:26.874653 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Id: None Jul 29 05:22:26.874653 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Name: None Jul 29 05:22:26.874653 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Identity-Status: Confirmed Jul 29 05:22:26.874653 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Is-Admin-Project: True Jul 29 05:22:26.874653 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Id: default Jul 29 05:22:26.874653 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Name: Default Jul 29 05:22:26.874653 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Id: c87396f5e6bf46f5b85720c8e365da81 Jul 29 05:22:26.874653 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Name: tempest-DeleteServersTestJSON-433700856 Jul 29 05:22:26.874653 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Role: member,reader Jul 29 05:22:26.874653 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Roles: member,reader Jul 29 05:22:26.877644 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c87396f5e6bf46f5b85720c8e365da81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c87396f5e6bf46f5b85720c8e365da81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c87396f5e6bf46f5b85720c8e365da81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c87396f5e6bf46f5b85720c8e365da81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:22:26.877644 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant: tempest-DeleteServersTestJSON-433700856 Jul 29 05:22:26.877644 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Id: c87396f5e6bf46f5b85720c8e365da81 Jul 29 05:22:26.877644 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Name: tempest-DeleteServersTestJSON-433700856 Jul 29 05:22:26.877644 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User: tempest-DeleteServersTestJSON-433700856-project Jul 29 05:22:26.877644 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Id: default Jul 29 05:22:26.877644 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Name: Default Jul 29 05:22:26.877644 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Id: 720be309cbe14940873d774b06e91bf9 Jul 29 05:22:26.877644 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Name: tempest-DeleteServersTestJSON-433700856-project Jul 29 05:22:26.877644 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: method: > Jul 29 05:22:26.877644 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: exception: Instance 51207b24-620a-4479-be28-4db53ef4073e could not be found. Jul 29 05:22:26.877644 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: action_args: {'id': '51207b24-620a-4479-be28-4db53ef4073e'} Jul 29 05:22:26.878384 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:22:26.878384 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:22:26.878384 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:22:26.878384 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:22:26.878384 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:22:26.878384 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:22:26.878384 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:22:26.878384 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:22:26.878384 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:22:26.878384 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:22:26.878384 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51207b24-620a-4479-be28-4db53ef4073e could not be found. Jul 29 05:22:26.878384 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:22:26.878384 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:22:26.878384 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:22:26.878384 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:22:26.878384 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:22:26.878384 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:22:26.878384 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:22:26.878384 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:22:26.878384 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:22:26.879676 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:22:26.879676 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 05:22:26.879676 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 05:22:26.879676 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 05:22:26.879676 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 05:22:26.879676 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:22:26.879676 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:22:26.879676 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:22:26.879676 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:22:26.879676 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51207b24-620a-4479-be28-4db53ef4073e could not be found. Jul 29 05:22:26.879676 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:22:26.879676 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:22:26.879676 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:22:26.879676 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:22:26.879676 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:22:26.879676 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:22:26.879676 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:22:26.879676 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:22:26.879676 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51207b24-620a-4479-be28-4db53ef4073e could not be found. Jul 29 05:22:26.879676 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:22:26.884194 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-d665466d-c5ce-4661-a7ae-c29ea62a0598 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Returning 404 to user: Instance 51207b24-620a-4479-be28-4db53ef4073e could not be found. {{(pid=117821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:22:26.885393 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-d665466d-c5ce-4661-a7ae-c29ea62a0598 tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] 10.222.0.49 "DELETE /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e" status: 404 len: 111 microversion: 2.1 time: 0.107937 Jul 29 05:22:26.885988 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 104/189] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 05:22:26 2022] DELETE /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 05:22:26.895084 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-ac861dbf-9a56-4836-a121-004a198ea20e tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:26.895905 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-ac861dbf-9a56-4836-a121-004a198ea20e tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] [instance: 51207b24-620a-4479-be28-4db53ef4073e] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:26.909125 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ac861dbf-9a56-4836-a121-004a198ea20e tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:26.909690 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ac861dbf-9a56-4836-a121-004a198ea20e tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:26.910590 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ac861dbf-9a56-4836-a121-004a198ea20e tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:26.911133 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ac861dbf-9a56-4836-a121-004a198ea20e tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:26.939125 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.wsgi [None req-ac861dbf-9a56-4836-a121-004a198ea20e tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] HTTP exception thrown: Instance 51207b24-620a-4479-be28-4db53ef4073e could not be found. Jul 29 05:22:26.940841 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-ac861dbf-9a56-4836-a121-004a198ea20e tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Request method failure captured: Jul 29 05:22:26.940841 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: request: GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e HTTP/1.1 Jul 29 05:22:26.940841 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept: application/json Jul 29 05:22:26.940841 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept-Encoding: identity Jul 29 05:22:26.940841 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Connection: close Jul 29 05:22:26.940841 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Length: 0 Jul 29 05:22:26.940841 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Type: application/json Jul 29 05:22:26.940841 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Host: 10.222.0.49 Jul 29 05:22:26.940841 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Openstack-System-Scope: None Jul 29 05:22:26.940841 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: User-Agent: python-urllib3/1.26.10 Jul 29 05:22:26.940841 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Auth-Token: gAAAAABi425Q5VJDrJAfdS5zYTBjP4ep4qqYIxmbMAGJcnaIdi1dkbCyDOx2kYBKGudkg1oYqyo3ToYin7mmGSZg_Smn56-cghjTrMBRePlaC6PcQ2p50vl0510TLIjYAamr-JAa0CrobhwxMJET50xypa5e7SJAxz435beKSabURsmLZM6UfPc Jul 29 05:22:26.940841 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Id: None Jul 29 05:22:26.940841 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Name: None Jul 29 05:22:26.940841 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Identity-Status: Confirmed Jul 29 05:22:26.940841 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Is-Admin-Project: True Jul 29 05:22:26.940841 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Id: default Jul 29 05:22:26.940841 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Name: Default Jul 29 05:22:26.940841 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Id: c87396f5e6bf46f5b85720c8e365da81 Jul 29 05:22:26.940841 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Name: tempest-DeleteServersTestJSON-433700856 Jul 29 05:22:26.940841 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Role: member,reader Jul 29 05:22:26.940841 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Roles: member,reader Jul 29 05:22:26.943416 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c87396f5e6bf46f5b85720c8e365da81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c87396f5e6bf46f5b85720c8e365da81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c87396f5e6bf46f5b85720c8e365da81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c87396f5e6bf46f5b85720c8e365da81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:22:26.943416 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant: tempest-DeleteServersTestJSON-433700856 Jul 29 05:22:26.943416 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Id: c87396f5e6bf46f5b85720c8e365da81 Jul 29 05:22:26.943416 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Name: tempest-DeleteServersTestJSON-433700856 Jul 29 05:22:26.943416 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User: tempest-DeleteServersTestJSON-433700856-project Jul 29 05:22:26.943416 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Id: default Jul 29 05:22:26.943416 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Name: Default Jul 29 05:22:26.943416 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Id: 720be309cbe14940873d774b06e91bf9 Jul 29 05:22:26.943416 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Name: tempest-DeleteServersTestJSON-433700856-project Jul 29 05:22:26.943416 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: method: > Jul 29 05:22:26.943416 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: exception: Instance 51207b24-620a-4479-be28-4db53ef4073e could not be found. Jul 29 05:22:26.943416 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: action_args: {'id': '51207b24-620a-4479-be28-4db53ef4073e'} Jul 29 05:22:26.946229 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:22:26.946229 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:22:26.946229 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:22:26.946229 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:22:26.946229 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:22:26.946229 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:22:26.946229 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:22:26.946229 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:22:26.946229 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:22:26.946229 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:22:26.946229 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51207b24-620a-4479-be28-4db53ef4073e could not be found. Jul 29 05:22:26.946229 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:22:26.946229 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:22:26.946229 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:22:26.946229 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:22:26.946229 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:22:26.946229 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:22:26.946229 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:22:26.946229 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:22:26.946229 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:22:26.948360 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:22:26.948360 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:22:26.948360 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:22:26.948360 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:22:26.948360 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:22:26.948360 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:22:26.948360 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:22:26.948360 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51207b24-620a-4479-be28-4db53ef4073e could not be found. Jul 29 05:22:26.948360 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:22:26.948360 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:22:26.948360 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:22:26.948360 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:22:26.948360 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:22:26.948360 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:22:26.948360 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:22:26.948360 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:22:26.948360 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51207b24-620a-4479-be28-4db53ef4073e could not be found. Jul 29 05:22:26.948360 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:22:26.952263 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-ac861dbf-9a56-4836-a121-004a198ea20e tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] Returning 404 to user: Instance 51207b24-620a-4479-be28-4db53ef4073e could not be found. {{(pid=117820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:22:26.953316 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-ac861dbf-9a56-4836-a121-004a198ea20e tempest-DeleteServersTestJSON-433700856 tempest-DeleteServersTestJSON-433700856-project] 10.222.0.49 "GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e" status: 404 len: 111 microversion: 2.1 time: 0.062624 Jul 29 05:22:26.958382 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 86/190] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:26 2022] GET /compute/v2.1/servers/51207b24-620a-4479-be28-4db53ef4073e => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 05:22:27.331661 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-6a76a521-e123-49f8-a4c0-358a255cb264 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:27.332976 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-6a76a521-e123-49f8-a4c0-358a255cb264 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:27.344090 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6a76a521-e123-49f8-a4c0-358a255cb264 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:27.355262 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6a76a521-e123-49f8-a4c0-358a255cb264 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:27.356814 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6a76a521-e123-49f8-a4c0-358a255cb264 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:27.357614 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6a76a521-e123-49f8-a4c0-358a255cb264 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:27.838816 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-6a76a521-e123-49f8-a4c0-358a255cb264 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:27.851273 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-6a76a521-e123-49f8-a4c0-358a255cb264 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1521 microversion: 2.1 time: 0.524295 Jul 29 05:22:27.852815 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 105/191] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:27 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1521 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:28.875831 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-77160d2e-addd-4108-af50-15264ea56aa3 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:28.876938 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-77160d2e-addd-4108-af50-15264ea56aa3 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:28.886575 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-77160d2e-addd-4108-af50-15264ea56aa3 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:28.887141 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-77160d2e-addd-4108-af50-15264ea56aa3 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:28.889442 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-77160d2e-addd-4108-af50-15264ea56aa3 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:28.889909 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-77160d2e-addd-4108-af50-15264ea56aa3 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:29.091581 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-77160d2e-addd-4108-af50-15264ea56aa3 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:29.102694 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-77160d2e-addd-4108-af50-15264ea56aa3 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1521 microversion: 2.1 time: 0.232529 Jul 29 05:22:29.103537 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 87/192] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:28 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:30.141694 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-395874e5-8910-4bda-84bb-f83e0de6eedf tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:30.144041 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-395874e5-8910-4bda-84bb-f83e0de6eedf tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:30.158940 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-395874e5-8910-4bda-84bb-f83e0de6eedf tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:30.160600 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-395874e5-8910-4bda-84bb-f83e0de6eedf tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:30.162769 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-395874e5-8910-4bda-84bb-f83e0de6eedf tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:30.163867 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-395874e5-8910-4bda-84bb-f83e0de6eedf tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:30.609394 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-395874e5-8910-4bda-84bb-f83e0de6eedf tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:30.625454 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-395874e5-8910-4bda-84bb-f83e0de6eedf tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1521 microversion: 2.1 time: 0.491886 Jul 29 05:22:30.626672 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 106/193] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:30 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1521 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:31.655007 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-765a4670-1069-4dfb-9eb3-901112a111ca tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:31.656184 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-765a4670-1069-4dfb-9eb3-901112a111ca tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:31.679322 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-765a4670-1069-4dfb-9eb3-901112a111ca tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:31.680748 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-765a4670-1069-4dfb-9eb3-901112a111ca tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:31.683309 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-765a4670-1069-4dfb-9eb3-901112a111ca tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:31.684176 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-765a4670-1069-4dfb-9eb3-901112a111ca tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:31.977641 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-765a4670-1069-4dfb-9eb3-901112a111ca tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:32.009151 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-765a4670-1069-4dfb-9eb3-901112a111ca tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1521 microversion: 2.1 time: 0.363866 Jul 29 05:22:32.011957 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 88/194] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:31 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1521 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:33.049930 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-c7686ee1-4bad-4a2b-b2cd-d6ad23033834 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:33.050722 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-c7686ee1-4bad-4a2b-b2cd-d6ad23033834 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:33.054870 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:22:33.060210 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c7686ee1-4bad-4a2b-b2cd-d6ad23033834 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:33.060764 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c7686ee1-4bad-4a2b-b2cd-d6ad23033834 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:33.061479 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c7686ee1-4bad-4a2b-b2cd-d6ad23033834 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:33.061953 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c7686ee1-4bad-4a2b-b2cd-d6ad23033834 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:33.304077 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-c7686ee1-4bad-4a2b-b2cd-d6ad23033834 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:33.314951 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-c7686ee1-4bad-4a2b-b2cd-d6ad23033834 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1521 microversion: 2.1 time: 0.270495 Jul 29 05:22:33.331746 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 107/195] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:33 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:34.340911 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-4fc7db61-92d2-4dca-98f4-cae926c30d8f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:34.341559 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-4fc7db61-92d2-4dca-98f4-cae926c30d8f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:34.349642 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-4fc7db61-92d2-4dca-98f4-cae926c30d8f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:34.350169 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-4fc7db61-92d2-4dca-98f4-cae926c30d8f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:34.351175 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-4fc7db61-92d2-4dca-98f4-cae926c30d8f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:34.351797 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-4fc7db61-92d2-4dca-98f4-cae926c30d8f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:34.592764 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-4fc7db61-92d2-4dca-98f4-cae926c30d8f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:34.601353 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-4fc7db61-92d2-4dca-98f4-cae926c30d8f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1521 microversion: 2.1 time: 0.264317 Jul 29 05:22:34.601943 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 89/196] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:34 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:35.638542 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-57d5007c-4b9c-431c-a6b8-2d796e46fb07 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:35.639241 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-57d5007c-4b9c-431c-a6b8-2d796e46fb07 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:35.648232 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-57d5007c-4b9c-431c-a6b8-2d796e46fb07 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:35.648797 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-57d5007c-4b9c-431c-a6b8-2d796e46fb07 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:35.649691 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-57d5007c-4b9c-431c-a6b8-2d796e46fb07 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:35.650276 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-57d5007c-4b9c-431c-a6b8-2d796e46fb07 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:36.003989 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-57d5007c-4b9c-431c-a6b8-2d796e46fb07 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:36.019457 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-57d5007c-4b9c-431c-a6b8-2d796e46fb07 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1521 microversion: 2.1 time: 0.384392 Jul 29 05:22:36.020504 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 108/197] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:35 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1521 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:37.058090 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-0a1da740-70b0-4890-bd30-8e2000f22a52 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:37.059128 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-0a1da740-70b0-4890-bd30-8e2000f22a52 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:37.071669 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0a1da740-70b0-4890-bd30-8e2000f22a52 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:37.071669 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0a1da740-70b0-4890-bd30-8e2000f22a52 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:37.072603 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0a1da740-70b0-4890-bd30-8e2000f22a52 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:37.073507 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0a1da740-70b0-4890-bd30-8e2000f22a52 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:37.303523 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-0a1da740-70b0-4890-bd30-8e2000f22a52 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:37.320962 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-0a1da740-70b0-4890-bd30-8e2000f22a52 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1521 microversion: 2.1 time: 0.268923 Jul 29 05:22:37.330116 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 90/198] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:37 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:38.346355 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-38c5d69b-56be-4d39-8bb9-995ae4906f3b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:38.347152 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-38c5d69b-56be-4d39-8bb9-995ae4906f3b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:38.355117 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-38c5d69b-56be-4d39-8bb9-995ae4906f3b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:38.355602 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-38c5d69b-56be-4d39-8bb9-995ae4906f3b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:38.356406 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-38c5d69b-56be-4d39-8bb9-995ae4906f3b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:38.356848 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-38c5d69b-56be-4d39-8bb9-995ae4906f3b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:38.550263 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-38c5d69b-56be-4d39-8bb9-995ae4906f3b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:38.558829 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-38c5d69b-56be-4d39-8bb9-995ae4906f3b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1521 microversion: 2.1 time: 0.217181 Jul 29 05:22:38.559443 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 109/199] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:38 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:22:39.582552 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-6343c345-2ff9-462d-88cc-40670ce746e8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:39.583236 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-6343c345-2ff9-462d-88cc-40670ce746e8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:39.590624 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6343c345-2ff9-462d-88cc-40670ce746e8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:39.591193 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6343c345-2ff9-462d-88cc-40670ce746e8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:39.592222 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6343c345-2ff9-462d-88cc-40670ce746e8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:39.592790 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6343c345-2ff9-462d-88cc-40670ce746e8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:39.748915 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-6343c345-2ff9-462d-88cc-40670ce746e8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:39.760500 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-6343c345-2ff9-462d-88cc-40670ce746e8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1521 microversion: 2.1 time: 0.182484 Jul 29 05:22:39.761614 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 91/200] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:39 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:40.785362 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-4d2b3638-78de-4a8e-941c-a7e33efafefb tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:40.786317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-4d2b3638-78de-4a8e-941c-a7e33efafefb tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:40.792687 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4d2b3638-78de-4a8e-941c-a7e33efafefb tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:40.793144 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4d2b3638-78de-4a8e-941c-a7e33efafefb tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:40.793961 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4d2b3638-78de-4a8e-941c-a7e33efafefb tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:40.794402 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4d2b3638-78de-4a8e-941c-a7e33efafefb tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:40.968913 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-4d2b3638-78de-4a8e-941c-a7e33efafefb tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:40.978931 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-4d2b3638-78de-4a8e-941c-a7e33efafefb tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1521 microversion: 2.1 time: 0.198451 Jul 29 05:22:40.979562 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 110/201] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:40 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:42.002607 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-cbcf9cca-7d48-4869-8f8f-884d8b1dd910 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:42.003765 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-cbcf9cca-7d48-4869-8f8f-884d8b1dd910 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:42.010792 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-cbcf9cca-7d48-4869-8f8f-884d8b1dd910 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:42.011424 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-cbcf9cca-7d48-4869-8f8f-884d8b1dd910 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:42.012269 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-cbcf9cca-7d48-4869-8f8f-884d8b1dd910 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:42.012706 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-cbcf9cca-7d48-4869-8f8f-884d8b1dd910 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:42.177883 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-cbcf9cca-7d48-4869-8f8f-884d8b1dd910 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:42.198001 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-cbcf9cca-7d48-4869-8f8f-884d8b1dd910 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1521 microversion: 2.1 time: 0.199409 Jul 29 05:22:42.199051 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 92/202] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:41 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:43.223477 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-aeeda562-28a5-4e5c-b3e3-e65db4b6b188 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:43.224529 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-aeeda562-28a5-4e5c-b3e3-e65db4b6b188 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:43.238574 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-aeeda562-28a5-4e5c-b3e3-e65db4b6b188 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:43.239110 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-aeeda562-28a5-4e5c-b3e3-e65db4b6b188 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:43.240170 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-aeeda562-28a5-4e5c-b3e3-e65db4b6b188 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:43.240682 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-aeeda562-28a5-4e5c-b3e3-e65db4b6b188 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:43.469596 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-aeeda562-28a5-4e5c-b3e3-e65db4b6b188 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:43.477814 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-aeeda562-28a5-4e5c-b3e3-e65db4b6b188 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1521 microversion: 2.1 time: 0.260395 Jul 29 05:22:43.478398 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 111/203] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:43 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:44.519337 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-483de7f3-c51e-4ddb-9647-1aa796b9fdf8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:44.520512 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-483de7f3-c51e-4ddb-9647-1aa796b9fdf8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:44.524031 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_api:SELECT=54 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:22:44.532354 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-483de7f3-c51e-4ddb-9647-1aa796b9fdf8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:44.532866 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-483de7f3-c51e-4ddb-9647-1aa796b9fdf8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:44.533764 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-483de7f3-c51e-4ddb-9647-1aa796b9fdf8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:44.534164 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-483de7f3-c51e-4ddb-9647-1aa796b9fdf8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:44.715500 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-483de7f3-c51e-4ddb-9647-1aa796b9fdf8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:44.725156 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-483de7f3-c51e-4ddb-9647-1aa796b9fdf8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1521 microversion: 2.1 time: 0.216459 Jul 29 05:22:44.725740 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 93/204] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:44 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:45.752934 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-41522d44-00e6-4ddb-b7c0-7de8707209df tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:45.753683 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-41522d44-00e6-4ddb-b7c0-7de8707209df tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:45.760502 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-41522d44-00e6-4ddb-b7c0-7de8707209df tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:45.761077 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-41522d44-00e6-4ddb-b7c0-7de8707209df tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:45.762074 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-41522d44-00e6-4ddb-b7c0-7de8707209df tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:45.762518 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-41522d44-00e6-4ddb-b7c0-7de8707209df tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:45.958134 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-41522d44-00e6-4ddb-b7c0-7de8707209df tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:45.976736 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-41522d44-00e6-4ddb-b7c0-7de8707209df tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1521 microversion: 2.1 time: 0.230834 Jul 29 05:22:45.977698 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 112/205] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:45 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:47.023719 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-b7e8e3a6-eec4-4fc5-b4a7-93467951191e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:47.025430 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-b7e8e3a6-eec4-4fc5-b4a7-93467951191e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:47.042636 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b7e8e3a6-eec4-4fc5-b4a7-93467951191e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:47.044190 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b7e8e3a6-eec4-4fc5-b4a7-93467951191e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:47.044924 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b7e8e3a6-eec4-4fc5-b4a7-93467951191e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:47.047871 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b7e8e3a6-eec4-4fc5-b4a7-93467951191e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:47.254250 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-b7e8e3a6-eec4-4fc5-b4a7-93467951191e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:47.262576 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-b7e8e3a6-eec4-4fc5-b4a7-93467951191e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1521 microversion: 2.1 time: 0.253546 Jul 29 05:22:47.263196 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 94/206] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:47 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:48.288674 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-763cb8cb-37bc-4b97-bb8e-211910710de0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:48.289644 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-763cb8cb-37bc-4b97-bb8e-211910710de0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:48.297826 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-763cb8cb-37bc-4b97-bb8e-211910710de0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:48.298432 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-763cb8cb-37bc-4b97-bb8e-211910710de0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:48.299431 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-763cb8cb-37bc-4b97-bb8e-211910710de0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:48.299910 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-763cb8cb-37bc-4b97-bb8e-211910710de0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:48.539152 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-763cb8cb-37bc-4b97-bb8e-211910710de0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:48.556446 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-763cb8cb-37bc-4b97-bb8e-211910710de0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1521 microversion: 2.1 time: 0.273625 Jul 29 05:22:48.566052 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 113/207] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:48 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:49.581184 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-71beea4d-ff8c-48db-839a-00e439a705b7 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:49.581817 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-71beea4d-ff8c-48db-839a-00e439a705b7 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:49.589934 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-71beea4d-ff8c-48db-839a-00e439a705b7 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:49.590696 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-71beea4d-ff8c-48db-839a-00e439a705b7 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:49.591931 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-71beea4d-ff8c-48db-839a-00e439a705b7 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:49.592603 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-71beea4d-ff8c-48db-839a-00e439a705b7 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:49.763252 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-71beea4d-ff8c-48db-839a-00e439a705b7 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:49.774497 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-71beea4d-ff8c-48db-839a-00e439a705b7 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1521 microversion: 2.1 time: 0.197474 Jul 29 05:22:49.775439 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 95/208] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:49 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:22:50.801741 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-85d70d3b-15c5-4523-bf5e-3b4d6a59e063 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:50.802425 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-85d70d3b-15c5-4523-bf5e-3b4d6a59e063 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:50.809703 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-85d70d3b-15c5-4523-bf5e-3b4d6a59e063 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:50.810672 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-85d70d3b-15c5-4523-bf5e-3b4d6a59e063 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:50.812662 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-85d70d3b-15c5-4523-bf5e-3b4d6a59e063 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:50.813578 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-85d70d3b-15c5-4523-bf5e-3b4d6a59e063 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:50.994286 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-85d70d3b-15c5-4523-bf5e-3b4d6a59e063 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:51.009005 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-85d70d3b-15c5-4523-bf5e-3b4d6a59e063 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1521 microversion: 2.1 time: 0.210775 Jul 29 05:22:51.010034 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 114/209] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:50 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:22:52.038935 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-c12e311f-3df3-44d0-85a3-21d4a3d65988 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:52.039737 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-c12e311f-3df3-44d0-85a3-21d4a3d65988 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:52.047305 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c12e311f-3df3-44d0-85a3-21d4a3d65988 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:52.047966 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c12e311f-3df3-44d0-85a3-21d4a3d65988 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:52.048830 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c12e311f-3df3-44d0-85a3-21d4a3d65988 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:52.049326 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c12e311f-3df3-44d0-85a3-21d4a3d65988 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:52.052911 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell1:SELECT=94 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:22:52.221130 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-c12e311f-3df3-44d0-85a3-21d4a3d65988 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:52.230254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-c12e311f-3df3-44d0-85a3-21d4a3d65988 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1521 microversion: 2.1 time: 0.195703 Jul 29 05:22:52.230941 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 96/210] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:52 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:22:53.260570 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-7416667d-33f9-45e6-b2c2-b89f8307088b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:53.261237 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-7416667d-33f9-45e6-b2c2-b89f8307088b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:53.269762 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7416667d-33f9-45e6-b2c2-b89f8307088b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:53.270351 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7416667d-33f9-45e6-b2c2-b89f8307088b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:53.271239 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7416667d-33f9-45e6-b2c2-b89f8307088b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:53.271831 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7416667d-33f9-45e6-b2c2-b89f8307088b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:53.433777 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-7416667d-33f9-45e6-b2c2-b89f8307088b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:53.443063 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-7416667d-33f9-45e6-b2c2-b89f8307088b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1521 microversion: 2.1 time: 0.186724 Jul 29 05:22:53.443841 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 115/211] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:53 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:22:54.475246 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-41c34e74-5705-45f2-bb1e-910adbb962b5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:54.476581 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-41c34e74-5705-45f2-bb1e-910adbb962b5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:54.495758 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-41c34e74-5705-45f2-bb1e-910adbb962b5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:54.495758 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-41c34e74-5705-45f2-bb1e-910adbb962b5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:54.495758 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-41c34e74-5705-45f2-bb1e-910adbb962b5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:54.495758 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-41c34e74-5705-45f2-bb1e-910adbb962b5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:54.703012 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-41c34e74-5705-45f2-bb1e-910adbb962b5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:54.711976 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-41c34e74-5705-45f2-bb1e-910adbb962b5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1501 microversion: 2.1 time: 0.247599 Jul 29 05:22:54.712773 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 97/212] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:54 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1501 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:54.754988 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-1d435198-6e74-487a-8c63-6adc59c13824 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:54.756217 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-1d435198-6e74-487a-8c63-6adc59c13824 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:54.769471 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1d435198-6e74-487a-8c63-6adc59c13824 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:54.770286 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1d435198-6e74-487a-8c63-6adc59c13824 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:54.771713 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1d435198-6e74-487a-8c63-6adc59c13824 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:54.772494 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1d435198-6e74-487a-8c63-6adc59c13824 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:54.782752 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell1:SELECT=79 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:22:54.969125 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-1d435198-6e74-487a-8c63-6adc59c13824 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:54.977931 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-1d435198-6e74-487a-8c63-6adc59c13824 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1517 microversion: 2.1 time: 0.230937 Jul 29 05:22:54.978529 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 116/213] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:54 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1517 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:22:56.472742 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-76ced0f1-480c-402f-986b-d5f68d14e9c5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:22:56.475182 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-76ced0f1-480c-402f-986b-d5f68d14e9c5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:56.481778 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-76ced0f1-480c-402f-986b-d5f68d14e9c5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:56.482223 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-76ced0f1-480c-402f-986b-d5f68d14e9c5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:56.483745 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-76ced0f1-480c-402f-986b-d5f68d14e9c5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:56.484265 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-76ced0f1-480c-402f-986b-d5f68d14e9c5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:56.510255 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.objects.instance [None req-76ced0f1-480c-402f-986b-d5f68d14e9c5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lazy-loading 'flavor' on Instance uuid 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d {{(pid=117820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:22:56.642735 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-76ced0f1-480c-402f-986b-d5f68d14e9c5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "POST /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d/action" status: 200 len: 32 microversion: 2.1 time: 0.174701 Jul 29 05:22:56.643609 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 98/214] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Jul 29 05:22:56 2022] POST /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d/action => generated 32 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 05:22:56.653362 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-658128f2-ea6b-4d0d-9a39-d8afe99e2bf5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:56.654169 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-658128f2-ea6b-4d0d-9a39-d8afe99e2bf5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:56.662200 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-658128f2-ea6b-4d0d-9a39-d8afe99e2bf5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:56.662569 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-658128f2-ea6b-4d0d-9a39-d8afe99e2bf5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:56.663379 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-658128f2-ea6b-4d0d-9a39-d8afe99e2bf5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:56.663833 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-658128f2-ea6b-4d0d-9a39-d8afe99e2bf5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:56.837582 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-658128f2-ea6b-4d0d-9a39-d8afe99e2bf5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:56.849165 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-658128f2-ea6b-4d0d-9a39-d8afe99e2bf5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1523 microversion: 2.1 time: 0.199616 Jul 29 05:22:56.850907 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 117/215] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:56 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1523 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:22:57.887749 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-0f9bc829-d78e-428d-adbd-15032da74f0e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:57.889005 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-0f9bc829-d78e-428d-adbd-15032da74f0e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:57.900018 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0f9bc829-d78e-428d-adbd-15032da74f0e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:57.900018 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0f9bc829-d78e-428d-adbd-15032da74f0e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:57.900018 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0f9bc829-d78e-428d-adbd-15032da74f0e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:57.901438 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0f9bc829-d78e-428d-adbd-15032da74f0e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:58.164405 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-0f9bc829-d78e-428d-adbd-15032da74f0e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:58.176216 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-0f9bc829-d78e-428d-adbd-15032da74f0e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1523 microversion: 2.1 time: 0.294522 Jul 29 05:22:58.179113 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 99/216] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:57 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1523 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:22:59.206812 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-6415d4c3-283a-4a1d-ba8a-e0b7027b5743 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:22:59.207957 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-6415d4c3-283a-4a1d-ba8a-e0b7027b5743 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:22:59.217086 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6415d4c3-283a-4a1d-ba8a-e0b7027b5743 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:59.217800 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6415d4c3-283a-4a1d-ba8a-e0b7027b5743 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:59.218927 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6415d4c3-283a-4a1d-ba8a-e0b7027b5743 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:22:59.219519 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6415d4c3-283a-4a1d-ba8a-e0b7027b5743 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:22:59.437833 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-6415d4c3-283a-4a1d-ba8a-e0b7027b5743 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:22:59.447483 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-6415d4c3-283a-4a1d-ba8a-e0b7027b5743 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1523 microversion: 2.1 time: 0.247067 Jul 29 05:22:59.448087 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 118/217] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:22:59 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1523 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:00.487014 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-26cb6bc6-a163-4674-bc79-64357e57c8ba tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:00.488111 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-26cb6bc6-a163-4674-bc79-64357e57c8ba tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:00.497690 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-26cb6bc6-a163-4674-bc79-64357e57c8ba tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:00.499088 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-26cb6bc6-a163-4674-bc79-64357e57c8ba tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:00.500447 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-26cb6bc6-a163-4674-bc79-64357e57c8ba tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:00.501135 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-26cb6bc6-a163-4674-bc79-64357e57c8ba tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:00.762311 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-26cb6bc6-a163-4674-bc79-64357e57c8ba tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:00.778614 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-26cb6bc6-a163-4674-bc79-64357e57c8ba tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1523 microversion: 2.1 time: 0.299204 Jul 29 05:23:00.780409 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 100/218] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:00 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1523 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:01.807031 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-56dabf65-9916-436e-90bb-eb6eedda994b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:01.808107 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-56dabf65-9916-436e-90bb-eb6eedda994b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:01.818686 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-56dabf65-9916-436e-90bb-eb6eedda994b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:01.819331 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-56dabf65-9916-436e-90bb-eb6eedda994b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:01.820435 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-56dabf65-9916-436e-90bb-eb6eedda994b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:01.821104 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-56dabf65-9916-436e-90bb-eb6eedda994b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:02.000119 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-56dabf65-9916-436e-90bb-eb6eedda994b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:02.010987 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-56dabf65-9916-436e-90bb-eb6eedda994b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1523 microversion: 2.1 time: 0.211705 Jul 29 05:23:02.011684 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 119/219] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:01 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:03.034894 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-bf61273c-22c2-4d2a-a0d3-9670a2a7509a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:03.035539 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-bf61273c-22c2-4d2a-a0d3-9670a2a7509a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:03.043168 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bf61273c-22c2-4d2a-a0d3-9670a2a7509a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:03.043792 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bf61273c-22c2-4d2a-a0d3-9670a2a7509a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:03.044687 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bf61273c-22c2-4d2a-a0d3-9670a2a7509a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:03.045736 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bf61273c-22c2-4d2a-a0d3-9670a2a7509a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:03.239969 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-bf61273c-22c2-4d2a-a0d3-9670a2a7509a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:03.253454 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-bf61273c-22c2-4d2a-a0d3-9670a2a7509a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1523 microversion: 2.1 time: 0.222032 Jul 29 05:23:03.254350 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 101/220] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:03 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:04.277449 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-a1e3d23f-50a0-4587-b337-8b6130006f37 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:04.278280 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-a1e3d23f-50a0-4587-b337-8b6130006f37 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:04.281226 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_api:SELECT=26 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:23:04.287744 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a1e3d23f-50a0-4587-b337-8b6130006f37 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:04.288202 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a1e3d23f-50a0-4587-b337-8b6130006f37 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:04.288980 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a1e3d23f-50a0-4587-b337-8b6130006f37 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:04.289415 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a1e3d23f-50a0-4587-b337-8b6130006f37 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:04.450151 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-a1e3d23f-50a0-4587-b337-8b6130006f37 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:04.459703 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-a1e3d23f-50a0-4587-b337-8b6130006f37 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1523 microversion: 2.1 time: 0.186251 Jul 29 05:23:04.460420 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 120/221] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:04 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:05.482093 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-3b90b733-f251-4b3f-93ce-18534ecb8f60 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:05.483230 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-3b90b733-f251-4b3f-93ce-18534ecb8f60 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:05.489609 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3b90b733-f251-4b3f-93ce-18534ecb8f60 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:05.490071 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3b90b733-f251-4b3f-93ce-18534ecb8f60 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:05.490860 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3b90b733-f251-4b3f-93ce-18534ecb8f60 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:05.491305 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3b90b733-f251-4b3f-93ce-18534ecb8f60 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:05.661283 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-3b90b733-f251-4b3f-93ce-18534ecb8f60 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:05.670338 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-3b90b733-f251-4b3f-93ce-18534ecb8f60 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1523 microversion: 2.1 time: 0.191787 Jul 29 05:23:05.671078 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 102/222] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:05 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1523 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:06.692335 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-c5013488-dd21-476c-bb11-76950dc70156 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:06.692968 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-c5013488-dd21-476c-bb11-76950dc70156 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:06.700025 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c5013488-dd21-476c-bb11-76950dc70156 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:06.700475 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c5013488-dd21-476c-bb11-76950dc70156 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:06.701822 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c5013488-dd21-476c-bb11-76950dc70156 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:06.702340 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c5013488-dd21-476c-bb11-76950dc70156 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:06.861639 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-c5013488-dd21-476c-bb11-76950dc70156 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:06.869415 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-c5013488-dd21-476c-bb11-76950dc70156 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1523 microversion: 2.1 time: 0.181086 Jul 29 05:23:06.870051 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 121/223] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:06 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:07.408420 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-be61364e-cad6-4287-9c0e-73e4b5a58828 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:07.409007 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-be61364e-cad6-4287-9c0e-73e4b5a58828 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:07.416416 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-be61364e-cad6-4287-9c0e-73e4b5a58828 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:07.416865 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-be61364e-cad6-4287-9c0e-73e4b5a58828 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:07.417656 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-be61364e-cad6-4287-9c0e-73e4b5a58828 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:07.418093 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-be61364e-cad6-4287-9c0e-73e4b5a58828 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:07.444647 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-be61364e-cad6-4287-9c0e-73e4b5a58828 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780/ips" status: 200 len: 148 microversion: 2.1 time: 0.040670 Jul 29 05:23:07.445132 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 103/224] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Jul 29 05:23:07 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:23:07.898843 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-dbb076f9-7b27-4e95-a9fc-063e072f93de tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:07.899959 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-dbb076f9-7b27-4e95-a9fc-063e072f93de tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:07.915500 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-dbb076f9-7b27-4e95-a9fc-063e072f93de tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:07.916357 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-dbb076f9-7b27-4e95-a9fc-063e072f93de tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:07.919021 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-dbb076f9-7b27-4e95-a9fc-063e072f93de tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:07.919935 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-dbb076f9-7b27-4e95-a9fc-063e072f93de tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:08.147016 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-dbb076f9-7b27-4e95-a9fc-063e072f93de tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:08.157592 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-dbb076f9-7b27-4e95-a9fc-063e072f93de tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1523 microversion: 2.1 time: 0.265221 Jul 29 05:23:08.158195 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 122/225] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:07 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1523 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:09.182663 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-3ff6cfb4-2601-453f-8604-9d478f740bbc tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:09.183411 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-3ff6cfb4-2601-453f-8604-9d478f740bbc tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:09.191119 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3ff6cfb4-2601-453f-8604-9d478f740bbc tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:09.191645 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3ff6cfb4-2601-453f-8604-9d478f740bbc tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:09.192481 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3ff6cfb4-2601-453f-8604-9d478f740bbc tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:09.192989 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3ff6cfb4-2601-453f-8604-9d478f740bbc tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:09.362157 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-3ff6cfb4-2601-453f-8604-9d478f740bbc tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:09.374991 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-3ff6cfb4-2601-453f-8604-9d478f740bbc tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1523 microversion: 2.1 time: 0.198374 Jul 29 05:23:09.375952 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 104/226] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:09 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:23:10.413527 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-6283aec0-2915-426f-8281-268ab49583d1 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:10.415998 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-6283aec0-2915-426f-8281-268ab49583d1 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:10.428915 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6283aec0-2915-426f-8281-268ab49583d1 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:10.429790 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6283aec0-2915-426f-8281-268ab49583d1 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:10.431428 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6283aec0-2915-426f-8281-268ab49583d1 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:10.432545 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6283aec0-2915-426f-8281-268ab49583d1 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:10.673473 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-6283aec0-2915-426f-8281-268ab49583d1 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:10.681938 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-6283aec0-2915-426f-8281-268ab49583d1 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1523 microversion: 2.1 time: 0.276192 Jul 29 05:23:10.682819 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 123/227] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:10 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1523 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:23:11.210082 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-9900f4d2-9a65-4f9b-b0f2-963ac3107618 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45636d85-9505-4a58-808a-cc8312d325b5"}} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:23:11.212603 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-9900f4d2-9a65-4f9b-b0f2-963ac3107618 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:11.219417 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9900f4d2-9a65-4f9b-b0f2-963ac3107618 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:11.219868 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9900f4d2-9a65-4f9b-b0f2-963ac3107618 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:11.220652 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9900f4d2-9a65-4f9b-b0f2-963ac3107618 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:11.221088 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9900f4d2-9a65-4f9b-b0f2-963ac3107618 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:11.708810 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-bcb63d20-d8b2-49b9-8499-5a5e93b65760 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:11.711077 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-bcb63d20-d8b2-49b9-8499-5a5e93b65760 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:11.727682 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bcb63d20-d8b2-49b9-8499-5a5e93b65760 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:11.728225 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bcb63d20-d8b2-49b9-8499-5a5e93b65760 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:11.730838 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bcb63d20-d8b2-49b9-8499-5a5e93b65760 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:11.731901 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bcb63d20-d8b2-49b9-8499-5a5e93b65760 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:11.939307 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-9900f4d2-9a65-4f9b-b0f2-963ac3107618 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "POST /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.732646 Jul 29 05:23:11.940446 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 105/228] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Jul 29 05:23:11 2022] POST /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780/os-volume_attachments => generated 194 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:23:11.976369 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-bcb63d20-d8b2-49b9-8499-5a5e93b65760 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:11.985495 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-bcb63d20-d8b2-49b9-8499-5a5e93b65760 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1523 microversion: 2.1 time: 0.281899 Jul 29 05:23:11.986267 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 124/229] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:11 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1523 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:13.009153 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-e75dfa54-bcb8-431d-a8ba-d18cfbf7171c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:13.010181 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-e75dfa54-bcb8-431d-a8ba-d18cfbf7171c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:13.017712 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e75dfa54-bcb8-431d-a8ba-d18cfbf7171c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:13.018257 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e75dfa54-bcb8-431d-a8ba-d18cfbf7171c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:13.019038 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e75dfa54-bcb8-431d-a8ba-d18cfbf7171c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:13.019523 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e75dfa54-bcb8-431d-a8ba-d18cfbf7171c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:13.208835 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-e75dfa54-bcb8-431d-a8ba-d18cfbf7171c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:13.216933 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-e75dfa54-bcb8-431d-a8ba-d18cfbf7171c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1523 microversion: 2.1 time: 0.212302 Jul 29 05:23:13.217345 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 106/230] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:13 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:14.238901 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-156c5750-0351-4b5e-b700-c6a471a2eaae tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:14.239665 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-156c5750-0351-4b5e-b700-c6a471a2eaae tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:14.247041 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-156c5750-0351-4b5e-b700-c6a471a2eaae tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:14.247651 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-156c5750-0351-4b5e-b700-c6a471a2eaae tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:14.248599 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-156c5750-0351-4b5e-b700-c6a471a2eaae tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:14.249174 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-156c5750-0351-4b5e-b700-c6a471a2eaae tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:14.418102 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-156c5750-0351-4b5e-b700-c6a471a2eaae tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:14.427416 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-156c5750-0351-4b5e-b700-c6a471a2eaae tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1523 microversion: 2.1 time: 0.192655 Jul 29 05:23:14.428017 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 125/231] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:14 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1523 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:15.453229 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-ae5c3c54-9f06-4459-8a23-31543f3ad87f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:15.453898 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-ae5c3c54-9f06-4459-8a23-31543f3ad87f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:15.456584 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_api:SELECT=28 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:23:15.462335 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ae5c3c54-9f06-4459-8a23-31543f3ad87f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:15.462920 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ae5c3c54-9f06-4459-8a23-31543f3ad87f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:15.463877 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ae5c3c54-9f06-4459-8a23-31543f3ad87f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:15.464321 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ae5c3c54-9f06-4459-8a23-31543f3ad87f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:15.674962 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-ae5c3c54-9f06-4459-8a23-31543f3ad87f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:15.685080 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-ae5c3c54-9f06-4459-8a23-31543f3ad87f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1523 microversion: 2.1 time: 0.237202 Jul 29 05:23:15.686242 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 107/232] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:15 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1523 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:16.714080 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-2d8b9a7b-c9f6-48e6-b12f-a686070492ba tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:16.714712 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-2d8b9a7b-c9f6-48e6-b12f-a686070492ba tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:16.722713 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2d8b9a7b-c9f6-48e6-b12f-a686070492ba tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:16.723171 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2d8b9a7b-c9f6-48e6-b12f-a686070492ba tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:16.724069 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2d8b9a7b-c9f6-48e6-b12f-a686070492ba tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:16.724517 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2d8b9a7b-c9f6-48e6-b12f-a686070492ba tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:16.904311 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-2d8b9a7b-c9f6-48e6-b12f-a686070492ba tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:16.915006 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-2d8b9a7b-c9f6-48e6-b12f-a686070492ba tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1523 microversion: 2.1 time: 0.206021 Jul 29 05:23:16.916021 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 126/233] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:16 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1523 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:17.953724 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-87915b7d-1b03-4664-9038-8499d29dae0b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:17.954839 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-87915b7d-1b03-4664-9038-8499d29dae0b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:17.969220 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-87915b7d-1b03-4664-9038-8499d29dae0b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:17.970211 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-87915b7d-1b03-4664-9038-8499d29dae0b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:17.971670 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-87915b7d-1b03-4664-9038-8499d29dae0b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:17.972422 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-87915b7d-1b03-4664-9038-8499d29dae0b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:18.196350 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-87915b7d-1b03-4664-9038-8499d29dae0b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:18.205034 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-87915b7d-1b03-4664-9038-8499d29dae0b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1523 microversion: 2.1 time: 0.259864 Jul 29 05:23:18.205717 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 108/234] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:17 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1523 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:19.230571 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-512442ef-502c-4905-a48c-95ffaa5eb2e4 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:19.232677 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-512442ef-502c-4905-a48c-95ffaa5eb2e4 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:19.243527 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-512442ef-502c-4905-a48c-95ffaa5eb2e4 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:19.245865 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-512442ef-502c-4905-a48c-95ffaa5eb2e4 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:19.247413 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-512442ef-502c-4905-a48c-95ffaa5eb2e4 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:19.248000 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-512442ef-502c-4905-a48c-95ffaa5eb2e4 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:19.477368 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-512442ef-502c-4905-a48c-95ffaa5eb2e4 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:19.505588 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-512442ef-502c-4905-a48c-95ffaa5eb2e4 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1503 microversion: 2.1 time: 0.276060 Jul 29 05:23:19.506275 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 127/235] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:19 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1503 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:19.530887 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-be76752f-d192-4f4b-b71f-d4a67b3f884e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b292212-50a8-4892-98bb-5aaf447cb73e"}} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:23:19.533357 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-be76752f-d192-4f4b-b71f-d4a67b3f884e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:19.548052 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-be76752f-d192-4f4b-b71f-d4a67b3f884e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:19.548819 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-be76752f-d192-4f4b-b71f-d4a67b3f884e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:19.549777 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-be76752f-d192-4f4b-b71f-d4a67b3f884e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:19.553593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-be76752f-d192-4f4b-b71f-d4a67b3f884e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:19.583227 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.wsgi [None req-be76752f-d192-4f4b-b71f-d4a67b3f884e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] HTTP exception thrown: Cannot 'attach_volume' instance 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d while it is in vm_state rescued Jul 29 05:23:19.585253 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-be76752f-d192-4f4b-b71f-d4a67b3f884e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Request method failure captured: Jul 29 05:23:19.585253 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: request: POST /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d/os-volume_attachments HTTP/1.1 Jul 29 05:23:19.585253 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept: application/json Jul 29 05:23:19.585253 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept-Encoding: identity Jul 29 05:23:19.585253 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Connection: close Jul 29 05:23:19.585253 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Length: 74 Jul 29 05:23:19.585253 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Type: application/json Jul 29 05:23:19.585253 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Host: 10.222.0.49 Jul 29 05:23:19.585253 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Openstack-System-Scope: None Jul 29 05:23:19.585253 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: User-Agent: python-urllib3/1.26.10 Jul 29 05:23:19.585253 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Auth-Token: gAAAAABi425NDze3MZ6r1VD0FCYdq0OmQOLp-a8UlwTMNu4OjL5RkBuPvg1CcwPwgOttOt-6wL5UPCvTmDT4dvtmSR2MiB9UhU4F3cFaVbG964PhwtxReJ17pRKIo-RqoKvGgdruft6DgwjaYgOO11XCIKmUEetc8GovjBVxuznVeh-B9PpnvOw Jul 29 05:23:19.585253 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Id: None Jul 29 05:23:19.585253 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Name: None Jul 29 05:23:19.585253 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Identity-Status: Confirmed Jul 29 05:23:19.585253 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Is-Admin-Project: True Jul 29 05:23:19.585253 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Id: default Jul 29 05:23:19.585253 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Name: Default Jul 29 05:23:19.585253 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Id: 153fe5d9d64346f6b7419eba91948678 Jul 29 05:23:19.585253 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1077257590 Jul 29 05:23:19.585253 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Role: member,reader Jul 29 05:23:19.585253 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Roles: member,reader Jul 29 05:23:19.587256 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/153fe5d9d64346f6b7419eba91948678"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/153fe5d9d64346f6b7419eba91948678"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_153fe5d9d64346f6b7419eba91948678"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/153fe5d9d64346f6b7419eba91948678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:23:19.587256 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1077257590 Jul 29 05:23:19.587256 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Id: 153fe5d9d64346f6b7419eba91948678 Jul 29 05:23:19.587256 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1077257590 Jul 29 05:23:19.587256 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User: tempest-ServerRescueNegativeTestJSON-1077257590-project Jul 29 05:23:19.587256 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Id: default Jul 29 05:23:19.587256 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Name: Default Jul 29 05:23:19.587256 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Id: 45ae88234e984149be8539757efa8733 Jul 29 05:23:19.587256 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1077257590-project Jul 29 05:23:19.587256 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Jul 29 05:23:19.587256 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: {"volumeAttachment": {"volumeId": "6b292212-50a8-4892-98bb-5aaf447cb73e"}} Jul 29 05:23:19.587256 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: method: > Jul 29 05:23:19.588514 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: exception: Cannot 'attach_volume' instance 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d while it is in vm_state rescued Jul 29 05:23:19.588514 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: action_args: {'server_id': '3f080dde-4e70-4d3f-aa8c-ced0a1065d3d', 'body': {'volumeAttachment': {'volumeId': '6b292212-50a8-4892-98bb-5aaf447cb73e'}}} Jul 29 05:23:19.588514 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:23:19.588514 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:23:19.588514 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 29 05:23:19.588514 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 29 05:23:19.588514 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 29 05:23:19.588514 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 29 05:23:19.588514 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 29 05:23:19.588514 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 29 05:23:19.588514 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 29 05:23:19.588514 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:23:19.588514 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:23:19.588514 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:23:19.588514 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:23:19.588514 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:23:19.588514 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:23:19.588514 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:23:19.588514 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:23:19.591582 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:23:19.591582 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:23:19.591582 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 05:23:19.591582 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 05:23:19.591582 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 05:23:19.591582 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 05:23:19.591582 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 05:23:19.591582 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 05:23:19.591582 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 29 05:23:19.591582 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 29 05:23:19.591582 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 29 05:23:19.591582 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 29 05:23:19.591582 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d while it is in vm_state rescued Jul 29 05:23:19.591582 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:23:19.591582 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:23:19.591582 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:23:19.591582 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:23:19.591582 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:23:19.591582 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:23:19.594388 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:23:19.594388 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:23:19.594388 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d while it is in vm_state rescued Jul 29 05:23:19.594388 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:23:19.594388 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-be76752f-d192-4f4b-b71f-d4a67b3f884e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Returning 409 to user: Cannot 'attach_volume' instance 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d while it is in vm_state rescued {{(pid=117820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:23:19.594388 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-be76752f-d192-4f4b-b71f-d4a67b3f884e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "POST /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.061239 Jul 29 05:23:19.594388 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 109/236] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Jul 29 05:23:19 2022] POST /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d/os-volume_attachments => generated 152 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 29 05:23:19.605153 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-61c57c7d-bf01-49b0-abaf-98b2e42f3591 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:23:19.605647 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-61c57c7d-bf01-49b0-abaf-98b2e42f3591 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:19.617404 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-61c57c7d-bf01-49b0-abaf-98b2e42f3591 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:19.618445 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-61c57c7d-bf01-49b0-abaf-98b2e42f3591 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:19.620296 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-61c57c7d-bf01-49b0-abaf-98b2e42f3591 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:19.621414 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-61c57c7d-bf01-49b0-abaf-98b2e42f3591 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:19.728606 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-61c57c7d-bf01-49b0-abaf-98b2e42f3591 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "POST /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d/action" status: 202 len: 0 microversion: 2.1 time: 0.131289 Jul 29 05:23:19.729598 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 128/237] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Jul 29 05:23:19 2022] POST /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 05:23:19.744869 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-d5cedfa7-c32c-4a48-b7bd-79273258de8a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:19.745660 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-d5cedfa7-c32c-4a48-b7bd-79273258de8a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:19.754979 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d5cedfa7-c32c-4a48-b7bd-79273258de8a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:19.756030 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d5cedfa7-c32c-4a48-b7bd-79273258de8a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:19.757584 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d5cedfa7-c32c-4a48-b7bd-79273258de8a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:19.758080 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d5cedfa7-c32c-4a48-b7bd-79273258de8a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:19.763650 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:23:19.767894 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-33b35114-c117-41ec-a67c-e3d748e148d6 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Action: 'create', calling method: .version_select at 0x7fa63adbd550>, body: {"keypair": {"name": "tempest-keypair-685329303", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5vsKPSCrosENDlY9jgN9lFyH+uoeP5fQDUZwQIpZ2QvjjBD9VAQe5Z2OsLr5ItErGkACI96/DgWlEL8ZjEy9kKflzDw6XxmMq8xgo6krLgUcIMqBpNAj52VJG+gU2oNQ=="}} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:23:19.793438 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.quota [None req-33b35114-c117-41ec-a67c-e3d748e148d6 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Getting quotas for project 9d8baaf2e23546ee8ed1de278617c7d2. Resources: {'key_pairs'} {{(pid=117821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:23:19.800940 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.quota [None req-33b35114-c117-41ec-a67c-e3d748e148d6 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Getting quotas for user 3c60b3a983f14f50b1b762a3954a1059 and project 9d8baaf2e23546ee8ed1de278617c7d2. Resources: {'key_pairs'} {{(pid=117821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:23:19.846472 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-33b35114-c117-41ec-a67c-e3d748e148d6 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.086068 Jul 29 05:23:19.847252 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 129/238] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Jul 29 05:23:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:23:20.052251 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-d5cedfa7-c32c-4a48-b7bd-79273258de8a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:20.067743 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-d5cedfa7-c32c-4a48-b7bd-79273258de8a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1511 microversion: 2.1 time: 0.326430 Jul 29 05:23:20.069819 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 110/239] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:19 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1511 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:23:21.098855 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-c39fcb94-c4da-457b-b05f-35bb89c71b73 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:21.101755 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-c39fcb94-c4da-457b-b05f-35bb89c71b73 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:21.118817 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c39fcb94-c4da-457b-b05f-35bb89c71b73 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:21.120144 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c39fcb94-c4da-457b-b05f-35bb89c71b73 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:21.123982 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c39fcb94-c4da-457b-b05f-35bb89c71b73 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:21.125075 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c39fcb94-c4da-457b-b05f-35bb89c71b73 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:21.387568 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-c39fcb94-c4da-457b-b05f-35bb89c71b73 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:21.404335 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-c39fcb94-c4da-457b-b05f-35bb89c71b73 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1511 microversion: 2.1 time: 0.314521 Jul 29 05:23:21.405596 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 130/240] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:21 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1511 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:21.801023 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-11948766-027a-49c4-8206-de503acfe641 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1878677369", "imageRef": "b7bf870d-4e7c-42fd-849f-72ac19277493", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b55efc63-6791-470d-af15-935a2f0fc83e"}], "security_groups": [{"name": "tempest-securitygroup--52021870"}], "key_name": "tempest-keypair-685329303", "user_data": "}} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:23:21.953301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.network.neutron [None req-11948766-027a-49c4-8206-de503acfe641 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] validate_networks() for [('b55efc63-6791-470d-af15-935a2f0fc83e', None, None, None, None, None)] {{(pid=117820) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 05:23:22.411229 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-11948766-027a-49c4-8206-de503acfe641 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Flavor limits 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 05:23:22.411760 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-11948766-027a-49c4-8206-de503acfe641 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Image limits 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 05:23:22.412238 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-11948766-027a-49c4-8206-de503acfe641 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Flavor pref 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 05:23:22.412652 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-11948766-027a-49c4-8206-de503acfe641 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Image pref 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 05:23:22.413076 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-11948766-027a-49c4-8206-de503acfe641 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 05:23:22.423911 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-11948766-027a-49c4-8206-de503acfe641 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:22.424368 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-11948766-027a-49c4-8206-de503acfe641 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:22.425187 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-11948766-027a-49c4-8206-de503acfe641 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:22.425628 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-11948766-027a-49c4-8206-de503acfe641 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:22.428717 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-d30f1254-cebb-45b7-a1df-1b2a857428ae tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:22.429529 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-d30f1254-cebb-45b7-a1df-1b2a857428ae tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:22.438853 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d30f1254-cebb-45b7-a1df-1b2a857428ae tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:22.439296 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d30f1254-cebb-45b7-a1df-1b2a857428ae tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:22.440111 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d30f1254-cebb-45b7-a1df-1b2a857428ae tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:22.440543 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d30f1254-cebb-45b7-a1df-1b2a857428ae tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:22.447508 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.quota [None req-11948766-027a-49c4-8206-de503acfe641 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Getting quotas for project 9d8baaf2e23546ee8ed1de278617c7d2. Resources: {'instances', 'ram', 'cores'} {{(pid=117820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:23:22.454978 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.quota [None req-11948766-027a-49c4-8206-de503acfe641 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Getting quotas for user 3c60b3a983f14f50b1b762a3954a1059 and project 9d8baaf2e23546ee8ed1de278617c7d2. Resources: {'instances', 'ram', 'cores'} {{(pid=117820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:23:22.477807 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-11948766-027a-49c4-8206-de503acfe641 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Going to run 1 instances... {{(pid=117820) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 05:23:22.483848 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-11948766-027a-49c4-8206-de503acfe641 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: b11929b6-7818-4cae-be4e-8941c93c6aca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b7bf870d-4e7c-42fd-849f-72ac19277493',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117820) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 05:23:22.552838 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-11948766-027a-49c4-8206-de503acfe641 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.761348 Jul 29 05:23:22.554201 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 111/241] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 05:23:21 2022] POST /compute/v2.1/servers => generated 400 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 05:23:22.572728 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-ab66103c-7d46-4dbb-9dbf-791ed2889831 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:22.573437 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-ab66103c-7d46-4dbb-9dbf-791ed2889831 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: b11929b6-7818-4cae-be4e-8941c93c6aca] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:22.642537 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-d30f1254-cebb-45b7-a1df-1b2a857428ae tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:22.645553 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-ab66103c-7d46-4dbb-9dbf-791ed2889831 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:22.657994 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-ab66103c-7d46-4dbb-9dbf-791ed2889831 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca" status: 200 len: 1241 microversion: 2.1 time: 0.089327 Jul 29 05:23:22.663511 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 112/242] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:22 2022] GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca => generated 1241 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:23:22.663668 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-d30f1254-cebb-45b7-a1df-1b2a857428ae tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1511 microversion: 2.1 time: 0.238023 Jul 29 05:23:22.663668 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 131/243] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:22 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1511 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:23:23.681287 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-810f352e-57cc-4ce0-b5b8-35a3649b14f0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:23.681909 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-810f352e-57cc-4ce0-b5b8-35a3649b14f0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: b11929b6-7818-4cae-be4e-8941c93c6aca] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:23.690814 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-810f352e-57cc-4ce0-b5b8-35a3649b14f0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:23.691279 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-810f352e-57cc-4ce0-b5b8-35a3649b14f0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:23.692101 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-810f352e-57cc-4ce0-b5b8-35a3649b14f0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:23.692546 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-810f352e-57cc-4ce0-b5b8-35a3649b14f0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:23.701548 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-f96bfd12-0325-4c58-a189-63c8fae57ed2 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:23.702403 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-f96bfd12-0325-4c58-a189-63c8fae57ed2 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:23.710456 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f96bfd12-0325-4c58-a189-63c8fae57ed2 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:23.710914 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f96bfd12-0325-4c58-a189-63c8fae57ed2 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:23.712256 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f96bfd12-0325-4c58-a189-63c8fae57ed2 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:23.712709 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f96bfd12-0325-4c58-a189-63c8fae57ed2 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:23.797583 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-810f352e-57cc-4ce0-b5b8-35a3649b14f0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:23.812144 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-810f352e-57cc-4ce0-b5b8-35a3649b14f0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca" status: 200 len: 1245 microversion: 2.1 time: 0.134581 Jul 29 05:23:23.813323 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 113/244] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:23 2022] GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca => generated 1245 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:23.912160 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-f96bfd12-0325-4c58-a189-63c8fae57ed2 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:23.914795 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:23:23.923157 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-f96bfd12-0325-4c58-a189-63c8fae57ed2 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1511 microversion: 2.1 time: 0.227278 Jul 29 05:23:23.923770 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 132/245] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:23 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1511 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:23:24.708021 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-26d69744-4a49-412b-9327-7ab3b74a77ac tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1955438054", "imageRef": "b7bf870d-4e7c-42fd-849f-72ac19277493", "flavorRef": "452"}} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:23:24.767600 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.network.neutron [None req-26d69744-4a49-412b-9327-7ab3b74a77ac tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] validate_networks() for None {{(pid=117820) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 05:23:24.848223 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-1a2cb4f4-e025-4bba-b550-50f5bd5fa140 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:24.849159 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-1a2cb4f4-e025-4bba-b550-50f5bd5fa140 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: b11929b6-7818-4cae-be4e-8941c93c6aca] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:24.860637 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1a2cb4f4-e025-4bba-b550-50f5bd5fa140 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:24.861442 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1a2cb4f4-e025-4bba-b550-50f5bd5fa140 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:24.862841 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1a2cb4f4-e025-4bba-b550-50f5bd5fa140 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:24.863670 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1a2cb4f4-e025-4bba-b550-50f5bd5fa140 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:24.977961 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-1a2cb4f4-e025-4bba-b550-50f5bd5fa140 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:24.993938 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-1a2cb4f4-e025-4bba-b550-50f5bd5fa140 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca" status: 200 len: 1245 microversion: 2.1 time: 0.149510 Jul 29 05:23:24.994998 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 133/246] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:24 2022] GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca => generated 1245 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:23:25.017172 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-04336faf-54c7-4f4d-9200-506afb8bb730 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:25.018669 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-04336faf-54c7-4f4d-9200-506afb8bb730 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:25.033957 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-04336faf-54c7-4f4d-9200-506afb8bb730 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:25.035625 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-04336faf-54c7-4f4d-9200-506afb8bb730 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:25.038634 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-04336faf-54c7-4f4d-9200-506afb8bb730 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:25.039284 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-04336faf-54c7-4f4d-9200-506afb8bb730 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:25.229445 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-26d69744-4a49-412b-9327-7ab3b74a77ac tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Flavor limits 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 05:23:25.230144 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-26d69744-4a49-412b-9327-7ab3b74a77ac tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Image limits 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 05:23:25.230631 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-26d69744-4a49-412b-9327-7ab3b74a77ac tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Flavor pref 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 05:23:25.231942 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-26d69744-4a49-412b-9327-7ab3b74a77ac tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Image pref 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 05:23:25.232905 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-26d69744-4a49-412b-9327-7ab3b74a77ac tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 05:23:25.244988 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-26d69744-4a49-412b-9327-7ab3b74a77ac tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:25.245523 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-26d69744-4a49-412b-9327-7ab3b74a77ac tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:25.246355 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-26d69744-4a49-412b-9327-7ab3b74a77ac tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:25.247264 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-26d69744-4a49-412b-9327-7ab3b74a77ac tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:25.269983 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.quota [None req-26d69744-4a49-412b-9327-7ab3b74a77ac tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Getting quotas for project 4804e980ecc84e12a90f01bca1acee0a. Resources: {'instances', 'ram', 'cores'} {{(pid=117820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:23:25.277148 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.quota [None req-26d69744-4a49-412b-9327-7ab3b74a77ac tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Getting quotas for user 073b335a6ba0400e83608e8a862904ee and project 4804e980ecc84e12a90f01bca1acee0a. Resources: {'instances', 'ram', 'cores'} {{(pid=117820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:23:25.307326 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-26d69744-4a49-412b-9327-7ab3b74a77ac tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Going to run 1 instances... {{(pid=117820) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 05:23:25.313401 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-26d69744-4a49-412b-9327-7ab3b74a77ac tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] [instance: f67587cf-7dfb-4577-8512-ef4dc3500073] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b7bf870d-4e7c-42fd-849f-72ac19277493',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117820) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 05:23:25.446346 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-26d69744-4a49-412b-9327-7ab3b74a77ac tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.741884 Jul 29 05:23:25.452150 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 114/247] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 05:23:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 29 05:23:25.476565 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-b7fe4c56-e86a-418a-ba69-8f09d688dd39 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:25.484088 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-b7fe4c56-e86a-418a-ba69-8f09d688dd39 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] [instance: f67587cf-7dfb-4577-8512-ef4dc3500073] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:25.592030 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-b7fe4c56-e86a-418a-ba69-8f09d688dd39 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b335a6ba0400e83608e8a862904ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4804e980ecc84e12a90f01bca1acee0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:25.622177 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-b7fe4c56-e86a-418a-ba69-8f09d688dd39 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] 10.222.0.49 "GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073" status: 200 len: 1215 microversion: 2.1 time: 0.156203 Jul 29 05:23:25.624170 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 115/248] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:25 2022] GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073 => generated 1215 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:25.794186 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-04336faf-54c7-4f4d-9200-506afb8bb730 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:25.806373 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-04336faf-54c7-4f4d-9200-506afb8bb730 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1511 microversion: 2.1 time: 0.809208 Jul 29 05:23:25.807459 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 134/249] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:24 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1511 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:26.027021 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-b0a0de5a-f7bb-4586-8421-dc4c5944db89 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:26.028226 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-b0a0de5a-f7bb-4586-8421-dc4c5944db89 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: b11929b6-7818-4cae-be4e-8941c93c6aca] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:26.044101 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b0a0de5a-f7bb-4586-8421-dc4c5944db89 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:26.045332 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b0a0de5a-f7bb-4586-8421-dc4c5944db89 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:26.048013 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b0a0de5a-f7bb-4586-8421-dc4c5944db89 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:26.049163 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b0a0de5a-f7bb-4586-8421-dc4c5944db89 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:26.207439 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-b0a0de5a-f7bb-4586-8421-dc4c5944db89 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:26.223780 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-b0a0de5a-f7bb-4586-8421-dc4c5944db89 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca" status: 200 len: 1293 microversion: 2.1 time: 0.205237 Jul 29 05:23:26.224758 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 116/250] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:26 2022] GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca => generated 1293 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:23:26.659623 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-9cfd65bd-c938-43fc-be53-97180aab8694 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:26.660731 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-9cfd65bd-c938-43fc-be53-97180aab8694 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] [instance: f67587cf-7dfb-4577-8512-ef4dc3500073] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:26.667590 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9cfd65bd-c938-43fc-be53-97180aab8694 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:26.668037 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9cfd65bd-c938-43fc-be53-97180aab8694 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:26.669647 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9cfd65bd-c938-43fc-be53-97180aab8694 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:26.670286 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9cfd65bd-c938-43fc-be53-97180aab8694 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:26.743277 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-9cfd65bd-c938-43fc-be53-97180aab8694 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b335a6ba0400e83608e8a862904ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4804e980ecc84e12a90f01bca1acee0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:26.760963 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-9cfd65bd-c938-43fc-be53-97180aab8694 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] 10.222.0.49 "GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073" status: 200 len: 1211 microversion: 2.1 time: 0.105126 Jul 29 05:23:26.762617 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 135/251] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:26 2022] GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073 => generated 1211 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:26.842427 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-d4e1b944-83c5-4829-8721-820585991e33 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:26.843443 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-d4e1b944-83c5-4829-8721-820585991e33 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:26.852869 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d4e1b944-83c5-4829-8721-820585991e33 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:26.853655 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d4e1b944-83c5-4829-8721-820585991e33 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:26.854702 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d4e1b944-83c5-4829-8721-820585991e33 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:26.855339 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d4e1b944-83c5-4829-8721-820585991e33 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:27.226897 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-d4e1b944-83c5-4829-8721-820585991e33 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:27.238642 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-d4e1b944-83c5-4829-8721-820585991e33 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1517 microversion: 2.1 time: 0.400072 Jul 29 05:23:27.239636 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 117/252] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:26 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1517 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:23:27.281902 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-42c0ed44-66f0-418a-bc09-41da499e63e8 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:27.291747 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-42c0ed44-66f0-418a-bc09-41da499e63e8 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: b11929b6-7818-4cae-be4e-8941c93c6aca] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:27.302260 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-42c0ed44-66f0-418a-bc09-41da499e63e8 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:27.303116 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-42c0ed44-66f0-418a-bc09-41da499e63e8 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:27.304126 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-42c0ed44-66f0-418a-bc09-41da499e63e8 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:27.304545 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-42c0ed44-66f0-418a-bc09-41da499e63e8 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:27.393117 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-42c0ed44-66f0-418a-bc09-41da499e63e8 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:27.406343 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-42c0ed44-66f0-418a-bc09-41da499e63e8 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca" status: 200 len: 1299 microversion: 2.1 time: 0.134708 Jul 29 05:23:27.407236 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 136/253] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:27 2022] GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca => generated 1299 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:27.799037 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-44980691-0c66-4ee6-bc88-22e7881f579f tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:27.799835 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-44980691-0c66-4ee6-bc88-22e7881f579f tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] [instance: f67587cf-7dfb-4577-8512-ef4dc3500073] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:27.821286 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-44980691-0c66-4ee6-bc88-22e7881f579f tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:27.821945 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-44980691-0c66-4ee6-bc88-22e7881f579f tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:27.822784 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-44980691-0c66-4ee6-bc88-22e7881f579f tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:27.823251 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-44980691-0c66-4ee6-bc88-22e7881f579f tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:28.016785 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-44980691-0c66-4ee6-bc88-22e7881f579f tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b335a6ba0400e83608e8a862904ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4804e980ecc84e12a90f01bca1acee0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:28.043075 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-44980691-0c66-4ee6-bc88-22e7881f579f tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] 10.222.0.49 "GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073" status: 200 len: 1273 microversion: 2.1 time: 0.247480 Jul 29 05:23:28.045173 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 118/254] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:27 2022] GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073 => generated 1273 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:28.401584 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-dac4d299-153a-49f4-a9e7-bfbcc4dc8580 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:28.404183 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-dac4d299-153a-49f4-a9e7-bfbcc4dc8580 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:28.418095 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-dac4d299-153a-49f4-a9e7-bfbcc4dc8580 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:28.419950 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-dac4d299-153a-49f4-a9e7-bfbcc4dc8580 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:28.421796 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-dac4d299-153a-49f4-a9e7-bfbcc4dc8580 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:28.422918 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-dac4d299-153a-49f4-a9e7-bfbcc4dc8580 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:28.460666 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-c41081bd-57e4-4cac-9fe5-585f88e7772d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:28.462374 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-c41081bd-57e4-4cac-9fe5-585f88e7772d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: b11929b6-7818-4cae-be4e-8941c93c6aca] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:28.493958 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c41081bd-57e4-4cac-9fe5-585f88e7772d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:28.494806 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c41081bd-57e4-4cac-9fe5-585f88e7772d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:28.499819 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c41081bd-57e4-4cac-9fe5-585f88e7772d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:28.503567 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c41081bd-57e4-4cac-9fe5-585f88e7772d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:28.532968 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-dac4d299-153a-49f4-a9e7-bfbcc4dc8580 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba/ips" status: 200 len: 145 microversion: 2.1 time: 0.135545 Jul 29 05:23:28.534829 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 137/255] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Jul 29 05:23:28 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba/ips => generated 145 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:23:29.022150 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-e38cd2c1-92b7-4153-9e8a-aab5c5a01e76 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Action: 'create', calling method: .version_select at 0x7fa63aea0310>, body: {"keypair": {"name": "tempest-keypair-2135817251", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzZMPk4rAz9D1seoGhnQJtdzUKPaihcokjycIb8QAUtgcECqW7tGtgonWDSgsTZtVMMqbbfxu2OpB74/dK7PqSMAR8dP9kPd4kxnCj10TYYUyDi2YWaqKUP4FqKatwSZg=="}} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:23:29.049744 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.quota [None req-e38cd2c1-92b7-4153-9e8a-aab5c5a01e76 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Getting quotas for project 153fe5d9d64346f6b7419eba91948678. Resources: {'key_pairs'} {{(pid=117821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:23:29.056733 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.quota [None req-e38cd2c1-92b7-4153-9e8a-aab5c5a01e76 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Getting quotas for user 45ae88234e984149be8539757efa8733 and project 153fe5d9d64346f6b7419eba91948678. Resources: {'key_pairs'} {{(pid=117821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:23:29.099701 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-e38cd2c1-92b7-4153-9e8a-aab5c5a01e76 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.083851 Jul 29 05:23:29.100912 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 138/256] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Jul 29 05:23:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:23:29.110847 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-199ff908-53cb-4e41-a9be-3085889af879 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:29.112114 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-199ff908-53cb-4e41-a9be-3085889af879 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] [instance: f67587cf-7dfb-4577-8512-ef4dc3500073] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:29.124162 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-199ff908-53cb-4e41-a9be-3085889af879 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:29.125057 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-199ff908-53cb-4e41-a9be-3085889af879 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:29.126553 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-199ff908-53cb-4e41-a9be-3085889af879 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:29.127484 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-199ff908-53cb-4e41-a9be-3085889af879 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:29.322669 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-199ff908-53cb-4e41-a9be-3085889af879 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b335a6ba0400e83608e8a862904ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4804e980ecc84e12a90f01bca1acee0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:29.340658 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-199ff908-53cb-4e41-a9be-3085889af879 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] 10.222.0.49 "GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073" status: 200 len: 1273 microversion: 2.1 time: 0.238183 Jul 29 05:23:29.341388 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 139/257] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:29 2022] GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073 => generated 1273 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:29.517869 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-c41081bd-57e4-4cac-9fe5-585f88e7772d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:29.533022 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-c41081bd-57e4-4cac-9fe5-585f88e7772d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca" status: 200 len: 1365 microversion: 2.1 time: 1.085034 Jul 29 05:23:29.535595 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 119/258] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:28 2022] GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca => generated 1365 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:30.365815 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-64deef1c-19e2-40cb-b272-c4329602d53b tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:30.367951 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-64deef1c-19e2-40cb-b272-c4329602d53b tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] [instance: f67587cf-7dfb-4577-8512-ef4dc3500073] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:30.386266 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-64deef1c-19e2-40cb-b272-c4329602d53b tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:30.387538 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-64deef1c-19e2-40cb-b272-c4329602d53b tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:30.390579 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-64deef1c-19e2-40cb-b272-c4329602d53b tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:30.392610 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-64deef1c-19e2-40cb-b272-c4329602d53b tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:30.568569 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-9136605d-a0ca-4221-b046-a92ace2b217f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:30.571824 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-9136605d-a0ca-4221-b046-a92ace2b217f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: b11929b6-7818-4cae-be4e-8941c93c6aca] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:30.590986 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9136605d-a0ca-4221-b046-a92ace2b217f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:30.595369 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9136605d-a0ca-4221-b046-a92ace2b217f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:30.598701 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9136605d-a0ca-4221-b046-a92ace2b217f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:30.599603 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9136605d-a0ca-4221-b046-a92ace2b217f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:31.039199 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-64deef1c-19e2-40cb-b272-c4329602d53b tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b335a6ba0400e83608e8a862904ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4804e980ecc84e12a90f01bca1acee0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:31.060582 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-64deef1c-19e2-40cb-b272-c4329602d53b tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] 10.222.0.49 "GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073" status: 200 len: 1315 microversion: 2.1 time: 0.700821 Jul 29 05:23:31.061366 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 140/259] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:30 2022] GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073 => generated 1315 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:31.380428 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-9136605d-a0ca-4221-b046-a92ace2b217f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:31.391263 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-9136605d-a0ca-4221-b046-a92ace2b217f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca" status: 200 len: 1365 microversion: 2.1 time: 0.828975 Jul 29 05:23:31.392392 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 120/260] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:30 2022] GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca => generated 1365 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:31.792080 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-d4874137-ba27-46c4-8899-87ad0be9afd4 req-7fd4a162-2b3d-4b72-a09f-09e02baaf838 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b11929b6-7818-4cae-be4e-8941c93c6aca", "tag": "1d1e98d2-d2a2-495e-8225-fe844a178a63"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:23:31.834215 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-d4874137-ba27-46c4-8899-87ad0be9afd4 req-7fd4a162-2b3d-4b72-a09f-09e02baaf838 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:31.834998 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-d4874137-ba27-46c4-8899-87ad0be9afd4 req-7fd4a162-2b3d-4b72-a09f-09e02baaf838 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:31.870749 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-d4874137-ba27-46c4-8899-87ad0be9afd4 req-7fd4a162-2b3d-4b72-a09f-09e02baaf838 service nova] Creating event network-changed:1d1e98d2-d2a2-495e-8225-fe844a178a63 for instance b11929b6-7818-4cae-be4e-8941c93c6aca on hv-cinder-85127 Jul 29 05:23:31.897651 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-d4874137-ba27-46c4-8899-87ad0be9afd4 req-7fd4a162-2b3d-4b72-a09f-09e02baaf838 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110568 Jul 29 05:23:31.898864 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 141/261] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:23:32.092984 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-bfe711b5-68f2-4e56-b328-819dd22ca2c0 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:32.094146 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-bfe711b5-68f2-4e56-b328-819dd22ca2c0 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] [instance: f67587cf-7dfb-4577-8512-ef4dc3500073] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:32.101390 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bfe711b5-68f2-4e56-b328-819dd22ca2c0 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:32.102218 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bfe711b5-68f2-4e56-b328-819dd22ca2c0 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:32.103258 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bfe711b5-68f2-4e56-b328-819dd22ca2c0 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:32.106920 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bfe711b5-68f2-4e56-b328-819dd22ca2c0 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:32.197361 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-86714b4b-cd59-418c-8ff5-4bfc7caa7b26 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c05e2031-ada4-4f0b-99b6-0386d27b81ff"}} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:23:32.201044 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-86714b4b-cd59-418c-8ff5-4bfc7caa7b26 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:32.214020 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-86714b4b-cd59-418c-8ff5-4bfc7caa7b26 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:32.216214 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-86714b4b-cd59-418c-8ff5-4bfc7caa7b26 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:32.217358 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-86714b4b-cd59-418c-8ff5-4bfc7caa7b26 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:32.217999 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-86714b4b-cd59-418c-8ff5-4bfc7caa7b26 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:32.541278 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-bfe711b5-68f2-4e56-b328-819dd22ca2c0 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b335a6ba0400e83608e8a862904ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4804e980ecc84e12a90f01bca1acee0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:32.562030 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-bfe711b5-68f2-4e56-b328-819dd22ca2c0 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] 10.222.0.49 "GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073" status: 200 len: 1315 microversion: 2.1 time: 0.481072 Jul 29 05:23:32.575384 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 121/262] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:32 2022] GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073 => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:32.575384 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-cffd1947-e651-4f59-afce-d89c43445eae tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:32.576519 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-cffd1947-e651-4f59-afce-d89c43445eae tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: b11929b6-7818-4cae-be4e-8941c93c6aca] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:32.593042 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-cffd1947-e651-4f59-afce-d89c43445eae tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:32.594930 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-cffd1947-e651-4f59-afce-d89c43445eae tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:32.596561 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-cffd1947-e651-4f59-afce-d89c43445eae tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:32.598655 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-cffd1947-e651-4f59-afce-d89c43445eae tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:32.690658 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-86714b4b-cd59-418c-8ff5-4bfc7caa7b26 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "POST /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.498699 Jul 29 05:23:32.691904 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 142/263] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Jul 29 05:23:32 2022] POST /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba/os-volume_attachments => generated 194 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:23:32.707557 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-ea42d013-04cf-4987-b6bf-6231deb166e5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2123512744", "imageRef": "b7bf870d-4e7c-42fd-849f-72ac19277493", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "71b5d5d0-8fbf-40b8-b58c-094f4ec4c2d9"}], "security_groups": [{"name": "tempest-securitygroup--1502154691"}], "key_name": "tempest-keypair-2135817251", "user_data": "}} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:23:32.945729 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.network.neutron [None req-ea42d013-04cf-4987-b6bf-6231deb166e5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] validate_networks() for [('71b5d5d0-8fbf-40b8-b58c-094f4ec4c2d9', None, None, None, None, None)] {{(pid=117821) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 05:23:33.176582 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-cffd1947-e651-4f59-afce-d89c43445eae tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:33.192280 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-cffd1947-e651-4f59-afce-d89c43445eae tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca" status: 200 len: 1365 microversion: 2.1 time: 0.626672 Jul 29 05:23:33.192872 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 122/264] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:32 2022] GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca => generated 1365 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:33.198273 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-0432f2c9-4e78-4a94-a6d2-891ed0463391 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:33.198802 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-0432f2c9-4e78-4a94-a6d2-891ed0463391 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:33.220392 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0432f2c9-4e78-4a94-a6d2-891ed0463391 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:33.226244 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0432f2c9-4e78-4a94-a6d2-891ed0463391 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:33.227367 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0432f2c9-4e78-4a94-a6d2-891ed0463391 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:33.227971 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0432f2c9-4e78-4a94-a6d2-891ed0463391 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:33.283132 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-0432f2c9-4e78-4a94-a6d2-891ed0463391 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0/ips" status: 200 len: 152 microversion: 2.20 time: 0.088900 Jul 29 05:23:33.289459 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 123/265] 10.222.0.49 () {60 vars in 1289 bytes} [Fri Jul 29 05:23:33 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0/ips => generated 152 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 05:23:33.289459 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-f1553c23-fa0e-4ba5-98d2-2b119a7db118 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1613343233", "imageRef": "b7bf870d-4e7c-42fd-849f-72ac19277493", "flavorRef": "452", "networks": [{"uuid": "6068f512-e267-445c-a8db-5edcf9da6f4b"}]}} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:23:33.374437 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.network.neutron [None req-f1553c23-fa0e-4ba5-98d2-2b119a7db118 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] validate_networks() for [('6068f512-e267-445c-a8db-5edcf9da6f4b', None, None, None, None, None)] {{(pid=117820) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 05:23:33.723973 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-ea42d013-04cf-4987-b6bf-6231deb166e5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Flavor limits 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 05:23:33.726439 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-ea42d013-04cf-4987-b6bf-6231deb166e5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Image limits 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 05:23:33.727944 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-ea42d013-04cf-4987-b6bf-6231deb166e5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Flavor pref 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 05:23:33.729400 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-ea42d013-04cf-4987-b6bf-6231deb166e5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Image pref 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 05:23:33.730185 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-ea42d013-04cf-4987-b6bf-6231deb166e5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 05:23:33.774859 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ea42d013-04cf-4987-b6bf-6231deb166e5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:33.778685 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ea42d013-04cf-4987-b6bf-6231deb166e5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:33.783018 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ea42d013-04cf-4987-b6bf-6231deb166e5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:33.783961 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ea42d013-04cf-4987-b6bf-6231deb166e5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:33.831185 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.quota [None req-ea42d013-04cf-4987-b6bf-6231deb166e5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Getting quotas for project 153fe5d9d64346f6b7419eba91948678. Resources: {'instances', 'ram', 'cores'} {{(pid=117821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:23:33.839578 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.quota [None req-ea42d013-04cf-4987-b6bf-6231deb166e5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Getting quotas for user 45ae88234e984149be8539757efa8733 and project 153fe5d9d64346f6b7419eba91948678. Resources: {'instances', 'ram', 'cores'} {{(pid=117821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:23:33.888949 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-ea42d013-04cf-4987-b6bf-6231deb166e5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Going to run 1 instances... {{(pid=117821) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 05:23:33.898947 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-ea42d013-04cf-4987-b6bf-6231deb166e5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b7bf870d-4e7c-42fd-849f-72ac19277493',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117821) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 05:23:33.936846 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-f1553c23-fa0e-4ba5-98d2-2b119a7db118 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Flavor limits 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 05:23:33.937399 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-f1553c23-fa0e-4ba5-98d2-2b119a7db118 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Image limits 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 05:23:33.938006 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-f1553c23-fa0e-4ba5-98d2-2b119a7db118 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Flavor pref 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 05:23:33.938430 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-f1553c23-fa0e-4ba5-98d2-2b119a7db118 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Image pref 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 05:23:33.939119 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-f1553c23-fa0e-4ba5-98d2-2b119a7db118 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 05:23:33.951539 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f1553c23-fa0e-4ba5-98d2-2b119a7db118 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:33.951899 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f1553c23-fa0e-4ba5-98d2-2b119a7db118 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:33.953061 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f1553c23-fa0e-4ba5-98d2-2b119a7db118 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:33.953670 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f1553c23-fa0e-4ba5-98d2-2b119a7db118 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:33.974633 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.quota [None req-f1553c23-fa0e-4ba5-98d2-2b119a7db118 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Getting quotas for project 1f75331a524c4a5a981dfd1fdc361467. Resources: {'instances', 'ram', 'cores'} {{(pid=117820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:23:33.978959 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.quota [None req-f1553c23-fa0e-4ba5-98d2-2b119a7db118 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Getting quotas for user 1690be2d7032472391fa96e23e0c1bf0 and project 1f75331a524c4a5a981dfd1fdc361467. Resources: {'instances', 'ram', 'cores'} {{(pid=117820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:23:33.993210 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-f1553c23-fa0e-4ba5-98d2-2b119a7db118 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Going to run 1 instances... {{(pid=117820) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 05:23:33.995484 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-f1553c23-fa0e-4ba5-98d2-2b119a7db118 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b7bf870d-4e7c-42fd-849f-72ac19277493',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117820) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 05:23:34.018780 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-ea42d013-04cf-4987-b6bf-6231deb166e5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.317587 Jul 29 05:23:34.019763 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 143/266] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 05:23:32 2022] POST /compute/v2.1/servers => generated 409 bytes in 1321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 05:23:34.028261 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-391b6096-3944-4949-b9cb-c8258449a7e7 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:34.029121 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-391b6096-3944-4949-b9cb-c8258449a7e7 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] [instance: f67587cf-7dfb-4577-8512-ef4dc3500073] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:34.038996 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-391b6096-3944-4949-b9cb-c8258449a7e7 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:34.039730 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-391b6096-3944-4949-b9cb-c8258449a7e7 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:34.041108 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-391b6096-3944-4949-b9cb-c8258449a7e7 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:34.041986 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-391b6096-3944-4949-b9cb-c8258449a7e7 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:34.079954 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-f1553c23-fa0e-4ba5-98d2-2b119a7db118 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.793986 Jul 29 05:23:34.090736 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 124/267] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 05:23:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 05:23:34.090736 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-efb2eca2-d2dd-4c9d-afe9-0ddf62d6979f req-7091ef15-04e9-4723-b831-fe846997302b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f67587cf-7dfb-4577-8512-ef4dc3500073", "tag": "8628c596-8348-4bfe-bb55-d19280454b65"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:23:34.112147 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-efb2eca2-d2dd-4c9d-afe9-0ddf62d6979f req-7091ef15-04e9-4723-b831-fe846997302b service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:34.112987 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-efb2eca2-d2dd-4c9d-afe9-0ddf62d6979f req-7091ef15-04e9-4723-b831-fe846997302b service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:34.130450 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-efb2eca2-d2dd-4c9d-afe9-0ddf62d6979f req-7091ef15-04e9-4723-b831-fe846997302b service nova] Creating event network-changed:8628c596-8348-4bfe-bb55-d19280454b65 for instance f67587cf-7dfb-4577-8512-ef4dc3500073 on hv-cinder-85127 Jul 29 05:23:34.142165 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-efb2eca2-d2dd-4c9d-afe9-0ddf62d6979f req-7091ef15-04e9-4723-b831-fe846997302b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058885 Jul 29 05:23:34.144782 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 125/268] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:23:34.160532 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-e888f6ae-f983-4980-8d6d-dc6fd758315b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:34.161832 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-e888f6ae-f983-4980-8d6d-dc6fd758315b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:34.310465 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-391b6096-3944-4949-b9cb-c8258449a7e7 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b335a6ba0400e83608e8a862904ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4804e980ecc84e12a90f01bca1acee0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:34.319541 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-391b6096-3944-4949-b9cb-c8258449a7e7 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] 10.222.0.49 "GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073" status: 200 len: 1315 microversion: 2.1 time: 0.298265 Jul 29 05:23:34.334999 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 144/269] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:34 2022] GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:34.358149 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-c45f6b7e-9b52-4610-9ca6-910b33ed87d6 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:34.360525 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-c45f6b7e-9b52-4610-9ca6-910b33ed87d6 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:34.373719 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=5 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:23:34.452863 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-e888f6ae-f983-4980-8d6d-dc6fd758315b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:34.493212 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-e888f6ae-f983-4980-8d6d-dc6fd758315b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1246 microversion: 2.1 time: 0.346459 Jul 29 05:23:34.503413 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 126/270] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:34 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1246 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:34.525506 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-498163eb-8d88-4dfc-a2a1-a8f0c8d2c5ae tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:34.532997 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-498163eb-8d88-4dfc-a2a1-a8f0c8d2c5ae tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: b11929b6-7818-4cae-be4e-8941c93c6aca] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:34.536853 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-c45f6b7e-9b52-4610-9ca6-910b33ed87d6 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:34.549423 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-c45f6b7e-9b52-4610-9ca6-910b33ed87d6 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20" status: 200 len: 1219 microversion: 2.1 time: 0.203636 Jul 29 05:23:34.550151 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 145/271] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:34 2022] GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20 => generated 1219 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:34.573249 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-498163eb-8d88-4dfc-a2a1-a8f0c8d2c5ae tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:34.573736 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-498163eb-8d88-4dfc-a2a1-a8f0c8d2c5ae tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:34.577598 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-498163eb-8d88-4dfc-a2a1-a8f0c8d2c5ae tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:34.578123 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-498163eb-8d88-4dfc-a2a1-a8f0c8d2c5ae tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:35.022238 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-498163eb-8d88-4dfc-a2a1-a8f0c8d2c5ae tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:35.034018 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-498163eb-8d88-4dfc-a2a1-a8f0c8d2c5ae tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca" status: 200 len: 1365 microversion: 2.1 time: 0.534745 Jul 29 05:23:35.035490 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 127/272] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:34 2022] GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca => generated 1365 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:35.345017 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-8df2653a-469d-49ba-8364-27d8ee07c1bb tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:35.345637 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-8df2653a-469d-49ba-8364-27d8ee07c1bb tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] [instance: f67587cf-7dfb-4577-8512-ef4dc3500073] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:35.352285 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8df2653a-469d-49ba-8364-27d8ee07c1bb tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:35.352736 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8df2653a-469d-49ba-8364-27d8ee07c1bb tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:35.353521 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8df2653a-469d-49ba-8364-27d8ee07c1bb tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:35.353956 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8df2653a-469d-49ba-8364-27d8ee07c1bb tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:35.522284 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-d247c3e3-d2c6-4877-b2e1-be7c5d9c7aa7 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:35.523929 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-d247c3e3-d2c6-4877-b2e1-be7c5d9c7aa7 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:35.534960 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d247c3e3-d2c6-4877-b2e1-be7c5d9c7aa7 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:35.535896 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d247c3e3-d2c6-4877-b2e1-be7c5d9c7aa7 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:35.536905 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d247c3e3-d2c6-4877-b2e1-be7c5d9c7aa7 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:35.537575 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d247c3e3-d2c6-4877-b2e1-be7c5d9c7aa7 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:35.544171 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-8df2653a-469d-49ba-8364-27d8ee07c1bb tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b335a6ba0400e83608e8a862904ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4804e980ecc84e12a90f01bca1acee0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:35.559287 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-8df2653a-469d-49ba-8364-27d8ee07c1bb tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] 10.222.0.49 "GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073" status: 200 len: 1315 microversion: 2.1 time: 0.217511 Jul 29 05:23:35.571620 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 146/273] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:35 2022] GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:35.585933 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-f075dfe3-1750-45c9-9d2e-028dc4f0240a tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:35.587060 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-f075dfe3-1750-45c9-9d2e-028dc4f0240a tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:35.600237 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f075dfe3-1750-45c9-9d2e-028dc4f0240a tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:35.600660 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f075dfe3-1750-45c9-9d2e-028dc4f0240a tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:35.601776 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f075dfe3-1750-45c9-9d2e-028dc4f0240a tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:35.604126 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f075dfe3-1750-45c9-9d2e-028dc4f0240a tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:35.623519 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-d247c3e3-d2c6-4877-b2e1-be7c5d9c7aa7 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:35.641162 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-d247c3e3-d2c6-4877-b2e1-be7c5d9c7aa7 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1298 microversion: 2.1 time: 0.123012 Jul 29 05:23:35.642348 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 128/274] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:35 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1298 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:23:35.696653 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-f075dfe3-1750-45c9-9d2e-028dc4f0240a tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:35.705871 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-f075dfe3-1750-45c9-9d2e-028dc4f0240a tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20" status: 200 len: 1271 microversion: 2.1 time: 0.132248 Jul 29 05:23:35.706061 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 147/275] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:35 2022] GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20 => generated 1271 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:36.035507 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-a72c6d37-0180-4161-a2e3-324a01178c92 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:23:36.036333 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-a72c6d37-0180-4161-a2e3-324a01178c92 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:36.044230 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a72c6d37-0180-4161-a2e3-324a01178c92 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:36.044836 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a72c6d37-0180-4161-a2e3-324a01178c92 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:36.045915 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a72c6d37-0180-4161-a2e3-324a01178c92 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:36.046617 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a72c6d37-0180-4161-a2e3-324a01178c92 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:36.070048 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-72c85d8d-0b9e-48a6-9d5e-38ca2638725b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:36.070993 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-72c85d8d-0b9e-48a6-9d5e-38ca2638725b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: b11929b6-7818-4cae-be4e-8941c93c6aca] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:36.079391 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-72c85d8d-0b9e-48a6-9d5e-38ca2638725b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:36.080000 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-72c85d8d-0b9e-48a6-9d5e-38ca2638725b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:36.080935 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-72c85d8d-0b9e-48a6-9d5e-38ca2638725b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:36.081376 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-72c85d8d-0b9e-48a6-9d5e-38ca2638725b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:36.091634 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.objects.instance [None req-a72c6d37-0180-4161-a2e3-324a01178c92 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lazy-loading 'flavor' on Instance uuid 6ff4221e-eadc-491b-9f3c-9b41413a63d0 {{(pid=117820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:23:36.284329 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-72c85d8d-0b9e-48a6-9d5e-38ca2638725b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:36.309528 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-72c85d8d-0b9e-48a6-9d5e-38ca2638725b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca" status: 200 len: 1365 microversion: 2.1 time: 0.229957 Jul 29 05:23:36.325569 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 148/276] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:36 2022] GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca => generated 1365 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:23:36.489410 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-a72c6d37-0180-4161-a2e3-324a01178c92 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "POST /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0/action" status: 202 len: 0 microversion: 2.20 time: 0.459213 Jul 29 05:23:36.490500 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 129/277] 10.222.0.49 () {62 vars in 1319 bytes} [Fri Jul 29 05:23:36 2022] POST /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0/action => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 29 05:23:36.507802 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-87eae19e-472a-4fc6-a473-88ebcd612ffd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:36.508609 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-87eae19e-472a-4fc6-a473-88ebcd612ffd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:36.520106 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-87eae19e-472a-4fc6-a473-88ebcd612ffd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:36.520386 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-87eae19e-472a-4fc6-a473-88ebcd612ffd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:36.521449 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-87eae19e-472a-4fc6-a473-88ebcd612ffd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:36.522689 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-87eae19e-472a-4fc6-a473-88ebcd612ffd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:36.603273 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-1bb5ba0f-2bd5-4d58-bba0-bc9d89ae4bce tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:36.604790 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-1bb5ba0f-2bd5-4d58-bba0-bc9d89ae4bce tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] [instance: f67587cf-7dfb-4577-8512-ef4dc3500073] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:36.620473 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1bb5ba0f-2bd5-4d58-bba0-bc9d89ae4bce tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:36.621974 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1bb5ba0f-2bd5-4d58-bba0-bc9d89ae4bce tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:36.623703 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1bb5ba0f-2bd5-4d58-bba0-bc9d89ae4bce tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:36.625054 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1bb5ba0f-2bd5-4d58-bba0-bc9d89ae4bce tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:36.717200 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-87eae19e-472a-4fc6-a473-88ebcd612ffd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:36.732427 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-87eae19e-472a-4fc6-a473-88ebcd612ffd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:36.734729 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-87eae19e-472a-4fc6-a473-88ebcd612ffd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:36.736757 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-87eae19e-472a-4fc6-a473-88ebcd612ffd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1722 microversion: 2.20 time: 0.237713 Jul 29 05:23:36.737749 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 149/278] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:23:36 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:23:36.744816 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-e3a4351e-3459-4763-ba72-fdf8c14bb152 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:36.745674 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-e3a4351e-3459-4763-ba72-fdf8c14bb152 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:36.757755 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e3a4351e-3459-4763-ba72-fdf8c14bb152 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:36.758417 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e3a4351e-3459-4763-ba72-fdf8c14bb152 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:36.760266 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e3a4351e-3459-4763-ba72-fdf8c14bb152 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:36.760868 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e3a4351e-3459-4763-ba72-fdf8c14bb152 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:36.857606 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-e3a4351e-3459-4763-ba72-fdf8c14bb152 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:36.867942 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-e3a4351e-3459-4763-ba72-fdf8c14bb152 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1298 microversion: 2.1 time: 0.128795 Jul 29 05:23:36.868537 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 150/279] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:36 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1298 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:36.874656 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-4c4cf80f-e1de-4fd0-aff3-2ddd0b01be7c tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:36.875529 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-4c4cf80f-e1de-4fd0-aff3-2ddd0b01be7c tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:36.878953 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-1bb5ba0f-2bd5-4d58-bba0-bc9d89ae4bce tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b335a6ba0400e83608e8a862904ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4804e980ecc84e12a90f01bca1acee0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:36.882231 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4c4cf80f-e1de-4fd0-aff3-2ddd0b01be7c tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:36.882913 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4c4cf80f-e1de-4fd0-aff3-2ddd0b01be7c tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:36.883952 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4c4cf80f-e1de-4fd0-aff3-2ddd0b01be7c tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:36.884554 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4c4cf80f-e1de-4fd0-aff3-2ddd0b01be7c tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:36.885441 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:23:36.901183 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-1bb5ba0f-2bd5-4d58-bba0-bc9d89ae4bce tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] 10.222.0.49 "GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073" status: 200 len: 1315 microversion: 2.1 time: 0.308270 Jul 29 05:23:36.902912 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 130/280] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:36 2022] GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:23:36.982855 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-4c4cf80f-e1de-4fd0-aff3-2ddd0b01be7c tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:36.985353 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:23:36.993692 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-4c4cf80f-e1de-4fd0-aff3-2ddd0b01be7c tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20" status: 200 len: 1271 microversion: 2.1 time: 0.123892 Jul 29 05:23:36.994781 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 151/281] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:36 2022] GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20 => generated 1271 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:37.341644 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-916fce94-1461-44f9-9b1c-2521bfaf471c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:37.343011 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-916fce94-1461-44f9-9b1c-2521bfaf471c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: b11929b6-7818-4cae-be4e-8941c93c6aca] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:37.377809 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-916fce94-1461-44f9-9b1c-2521bfaf471c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:37.382029 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-916fce94-1461-44f9-9b1c-2521bfaf471c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:37.385014 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-916fce94-1461-44f9-9b1c-2521bfaf471c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:37.389140 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-916fce94-1461-44f9-9b1c-2521bfaf471c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:37.766219 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-1e496896-901b-417c-bc91-a733ede9fda2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:37.767586 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-1e496896-901b-417c-bc91-a733ede9fda2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:37.780339 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1e496896-901b-417c-bc91-a733ede9fda2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:37.781443 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1e496896-901b-417c-bc91-a733ede9fda2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:37.782876 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1e496896-901b-417c-bc91-a733ede9fda2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:37.783323 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1e496896-901b-417c-bc91-a733ede9fda2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:38.123592 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-1e496896-901b-417c-bc91-a733ede9fda2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:38.135375 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-1e496896-901b-417c-bc91-a733ede9fda2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:38.140408 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-1e496896-901b-417c-bc91-a733ede9fda2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:38.142618 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-1e496896-901b-417c-bc91-a733ede9fda2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1722 microversion: 2.20 time: 0.381975 Jul 29 05:23:38.143935 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 152/282] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:23:37 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1722 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:23:38.149611 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-b0b50f21-768c-421b-bedc-7f81454c38ce tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:38.150633 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-b0b50f21-768c-421b-bedc-7f81454c38ce tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:38.159025 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b0b50f21-768c-421b-bedc-7f81454c38ce tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:38.160246 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b0b50f21-768c-421b-bedc-7f81454c38ce tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:38.161353 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b0b50f21-768c-421b-bedc-7f81454c38ce tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:38.162708 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b0b50f21-768c-421b-bedc-7f81454c38ce tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:38.341371 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-b0b50f21-768c-421b-bedc-7f81454c38ce tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:38.350749 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-b0b50f21-768c-421b-bedc-7f81454c38ce tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1304 microversion: 2.1 time: 0.205138 Jul 29 05:23:38.351689 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 153/283] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:38 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1304 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:38.363591 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-4a3d8bde-b8d5-4843-86b7-70aa2cecaa4c tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:38.364412 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-4a3d8bde-b8d5-4843-86b7-70aa2cecaa4c tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] [instance: f67587cf-7dfb-4577-8512-ef4dc3500073] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:38.388380 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4a3d8bde-b8d5-4843-86b7-70aa2cecaa4c tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:38.389281 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4a3d8bde-b8d5-4843-86b7-70aa2cecaa4c tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:38.390260 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4a3d8bde-b8d5-4843-86b7-70aa2cecaa4c tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:38.391124 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4a3d8bde-b8d5-4843-86b7-70aa2cecaa4c tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:38.568820 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-916fce94-1461-44f9-9b1c-2521bfaf471c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:38.581237 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-916fce94-1461-44f9-9b1c-2521bfaf471c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca" status: 200 len: 1365 microversion: 2.1 time: 1.254202 Jul 29 05:23:38.582159 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 131/284] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:37 2022] GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca => generated 1365 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:23:38.591205 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-0a5e74d4-7e6b-49a5-84bd-c6f171847baf tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:38.592187 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-0a5e74d4-7e6b-49a5-84bd-c6f171847baf tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:38.595670 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:23:38.606760 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0a5e74d4-7e6b-49a5-84bd-c6f171847baf tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:38.607149 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0a5e74d4-7e6b-49a5-84bd-c6f171847baf tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:38.608454 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0a5e74d4-7e6b-49a5-84bd-c6f171847baf tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:38.608916 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0a5e74d4-7e6b-49a5-84bd-c6f171847baf tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:38.626831 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-4a3d8bde-b8d5-4843-86b7-70aa2cecaa4c tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b335a6ba0400e83608e8a862904ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4804e980ecc84e12a90f01bca1acee0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:38.644067 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-4a3d8bde-b8d5-4843-86b7-70aa2cecaa4c tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] 10.222.0.49 "GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073" status: 200 len: 1315 microversion: 2.1 time: 0.290708 Jul 29 05:23:38.657845 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 154/285] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:38 2022] GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073 => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:38.657845 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-cb15b275-d29b-4c48-a3e6-854d45871907 req-fbde82d1-3795-4c3f-9c52-7aeeb3122810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b11929b6-7818-4cae-be4e-8941c93c6aca", "name": "network-vif-plugged", "status": "completed", "tag": "1d1e98d2-d2a2-495e-8225-fe844a178a63"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:23:38.671774 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-cb15b275-d29b-4c48-a3e6-854d45871907 req-fbde82d1-3795-4c3f-9c52-7aeeb3122810 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:38.672514 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-cb15b275-d29b-4c48-a3e6-854d45871907 req-fbde82d1-3795-4c3f-9c52-7aeeb3122810 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:38.687110 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-cb15b275-d29b-4c48-a3e6-854d45871907 req-fbde82d1-3795-4c3f-9c52-7aeeb3122810 service nova] Creating event network-vif-plugged:1d1e98d2-d2a2-495e-8225-fe844a178a63 for instance b11929b6-7818-4cae-be4e-8941c93c6aca on hv-cinder-85127 Jul 29 05:23:38.695405 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-cb15b275-d29b-4c48-a3e6-854d45871907 req-fbde82d1-3795-4c3f-9c52-7aeeb3122810 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047010 Jul 29 05:23:38.696061 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 155/286] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:23:38.790003 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-0a5e74d4-7e6b-49a5-84bd-c6f171847baf tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:38.810049 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-0a5e74d4-7e6b-49a5-84bd-c6f171847baf tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20" status: 200 len: 1277 microversion: 2.1 time: 0.224783 Jul 29 05:23:38.823333 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 132/287] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:38 2022] GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20 => generated 1277 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:39.188806 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-bfe2a5dc-3783-4e9b-9edd-e434a12598ba tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:39.190793 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-bfe2a5dc-3783-4e9b-9edd-e434a12598ba tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:39.202401 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bfe2a5dc-3783-4e9b-9edd-e434a12598ba tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:39.203567 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bfe2a5dc-3783-4e9b-9edd-e434a12598ba tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:39.207902 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bfe2a5dc-3783-4e9b-9edd-e434a12598ba tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:39.208663 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bfe2a5dc-3783-4e9b-9edd-e434a12598ba tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:39.392857 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-e82d4e83-485e-4650-93df-d7b29914b3cf tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:39.395542 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-e82d4e83-485e-4650-93df-d7b29914b3cf tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:39.408944 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e82d4e83-485e-4650-93df-d7b29914b3cf tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:39.410785 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e82d4e83-485e-4650-93df-d7b29914b3cf tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:39.413661 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e82d4e83-485e-4650-93df-d7b29914b3cf tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:39.415234 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e82d4e83-485e-4650-93df-d7b29914b3cf tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:39.466744 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-bfe2a5dc-3783-4e9b-9edd-e434a12598ba tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:39.487948 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-bfe2a5dc-3783-4e9b-9edd-e434a12598ba tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:39.491319 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-bfe2a5dc-3783-4e9b-9edd-e434a12598ba tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:39.493974 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-bfe2a5dc-3783-4e9b-9edd-e434a12598ba tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1722 microversion: 2.20 time: 0.317038 Jul 29 05:23:39.496373 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 156/288] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:23:39 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1722 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:23:39.573070 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-e82d4e83-485e-4650-93df-d7b29914b3cf tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:39.587608 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-e82d4e83-485e-4650-93df-d7b29914b3cf tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1304 microversion: 2.1 time: 0.203830 Jul 29 05:23:39.588300 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 133/289] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:39 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1304 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:23:39.619012 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-90eab99c-8c20-494a-b69a-ce4a4bcb1a22 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:39.620051 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-90eab99c-8c20-494a-b69a-ce4a4bcb1a22 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: b11929b6-7818-4cae-be4e-8941c93c6aca] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:39.632198 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-90eab99c-8c20-494a-b69a-ce4a4bcb1a22 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:39.634024 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-90eab99c-8c20-494a-b69a-ce4a4bcb1a22 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:39.635792 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-90eab99c-8c20-494a-b69a-ce4a4bcb1a22 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:39.637236 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-90eab99c-8c20-494a-b69a-ce4a4bcb1a22 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:39.665891 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-7dbb2b93-4945-4fc9-b052-c922bafd510b tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:39.667099 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-7dbb2b93-4945-4fc9-b052-c922bafd510b tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] [instance: f67587cf-7dfb-4577-8512-ef4dc3500073] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:39.675135 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7dbb2b93-4945-4fc9-b052-c922bafd510b tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:39.676020 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7dbb2b93-4945-4fc9-b052-c922bafd510b tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:39.677318 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7dbb2b93-4945-4fc9-b052-c922bafd510b tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:39.678064 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7dbb2b93-4945-4fc9-b052-c922bafd510b tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:39.941630 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-90eab99c-8c20-494a-b69a-ce4a4bcb1a22 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:39.955383 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-90eab99c-8c20-494a-b69a-ce4a4bcb1a22 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca" status: 200 len: 1365 microversion: 2.1 time: 0.340639 Jul 29 05:23:39.967410 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 157/290] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:39 2022] GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca => generated 1365 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:39.968390 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-1df4c988-3c1d-4014-b2dc-e84f5473c8df tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:39.973356 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-1df4c988-3c1d-4014-b2dc-e84f5473c8df tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:39.978167 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1df4c988-3c1d-4014-b2dc-e84f5473c8df tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:39.978660 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1df4c988-3c1d-4014-b2dc-e84f5473c8df tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:39.980650 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1df4c988-3c1d-4014-b2dc-e84f5473c8df tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:39.981039 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1df4c988-3c1d-4014-b2dc-e84f5473c8df tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:40.171807 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-1df4c988-3c1d-4014-b2dc-e84f5473c8df tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:40.182098 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-1df4c988-3c1d-4014-b2dc-e84f5473c8df tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20" status: 200 len: 1319 microversion: 2.1 time: 0.222182 Jul 29 05:23:40.182934 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 158/291] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:39 2022] GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20 => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:40.526684 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-78d022d8-1cdb-4373-bbad-7d4e3714416f tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:40.528318 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-78d022d8-1cdb-4373-bbad-7d4e3714416f tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:40.539487 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-78d022d8-1cdb-4373-bbad-7d4e3714416f tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:40.540257 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-78d022d8-1cdb-4373-bbad-7d4e3714416f tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:40.541314 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-78d022d8-1cdb-4373-bbad-7d4e3714416f tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:40.541932 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-78d022d8-1cdb-4373-bbad-7d4e3714416f tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:40.666176 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-7dbb2b93-4945-4fc9-b052-c922bafd510b tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b335a6ba0400e83608e8a862904ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4804e980ecc84e12a90f01bca1acee0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:40.677155 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-7dbb2b93-4945-4fc9-b052-c922bafd510b tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] 10.222.0.49 "GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073" status: 200 len: 1315 microversion: 2.1 time: 1.014931 Jul 29 05:23:40.678362 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 134/292] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:39 2022] GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073 => generated 1315 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:23:40.684517 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-28d4b2bb-4f87-4132-a182-4df06e47b4bb tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:40.685674 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-28d4b2bb-4f87-4132-a182-4df06e47b4bb tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:40.693203 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-28d4b2bb-4f87-4132-a182-4df06e47b4bb tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:40.693927 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-28d4b2bb-4f87-4132-a182-4df06e47b4bb tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:40.695134 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-28d4b2bb-4f87-4132-a182-4df06e47b4bb tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:40.695954 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-28d4b2bb-4f87-4132-a182-4df06e47b4bb tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:40.834631 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-78d022d8-1cdb-4373-bbad-7d4e3714416f tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:40.865825 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-78d022d8-1cdb-4373-bbad-7d4e3714416f tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:40.870622 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-78d022d8-1cdb-4373-bbad-7d4e3714416f tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:40.874130 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-78d022d8-1cdb-4373-bbad-7d4e3714416f tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1722 microversion: 2.20 time: 0.351855 Jul 29 05:23:40.875153 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 159/293] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:23:40 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1722 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:23:40.884675 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-7dd58ca1-2499-4260-8fb5-044d5ebfae3b req-22ba511f-4926-49aa-86f9-2bb51e00eb4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f67587cf-7dfb-4577-8512-ef4dc3500073", "name": "network-vif-plugged", "status": "completed", "tag": "8628c596-8348-4bfe-bb55-d19280454b65"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:23:40.906759 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-7dd58ca1-2499-4260-8fb5-044d5ebfae3b req-22ba511f-4926-49aa-86f9-2bb51e00eb4d service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:40.907790 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-7dd58ca1-2499-4260-8fb5-044d5ebfae3b req-22ba511f-4926-49aa-86f9-2bb51e00eb4d service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:40.940971 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-7dd58ca1-2499-4260-8fb5-044d5ebfae3b req-22ba511f-4926-49aa-86f9-2bb51e00eb4d service nova] Creating event network-vif-plugged:8628c596-8348-4bfe-bb55-d19280454b65 for instance f67587cf-7dfb-4577-8512-ef4dc3500073 on hv-cinder-85127 Jul 29 05:23:40.952426 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-7dd58ca1-2499-4260-8fb5-044d5ebfae3b req-22ba511f-4926-49aa-86f9-2bb51e00eb4d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074793 Jul 29 05:23:40.954083 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 160/294] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:23:41.002415 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-a2e4b59e-1ce2-4a5c-91ff-1227ad247c0f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:41.003952 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-a2e4b59e-1ce2-4a5c-91ff-1227ad247c0f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: b11929b6-7818-4cae-be4e-8941c93c6aca] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:41.015435 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a2e4b59e-1ce2-4a5c-91ff-1227ad247c0f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:41.016378 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a2e4b59e-1ce2-4a5c-91ff-1227ad247c0f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:41.018036 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a2e4b59e-1ce2-4a5c-91ff-1227ad247c0f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:41.018708 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a2e4b59e-1ce2-4a5c-91ff-1227ad247c0f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:41.148615 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-28d4b2bb-4f87-4132-a182-4df06e47b4bb tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:41.164780 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-28d4b2bb-4f87-4132-a182-4df06e47b4bb tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1372 microversion: 2.1 time: 0.484722 Jul 29 05:23:41.166497 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 135/295] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:40 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1372 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:41.208427 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-59eaaebf-8bdd-415f-be3c-c2f761e6443d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:41.209522 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-59eaaebf-8bdd-415f-be3c-c2f761e6443d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:41.218973 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-59eaaebf-8bdd-415f-be3c-c2f761e6443d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:41.219868 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-59eaaebf-8bdd-415f-be3c-c2f761e6443d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:41.221542 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-59eaaebf-8bdd-415f-be3c-c2f761e6443d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:41.222205 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-59eaaebf-8bdd-415f-be3c-c2f761e6443d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:41.273939 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-a2e4b59e-1ce2-4a5c-91ff-1227ad247c0f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:41.284120 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-a2e4b59e-1ce2-4a5c-91ff-1227ad247c0f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca" status: 200 len: 1554 microversion: 2.1 time: 0.289427 Jul 29 05:23:41.285554 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 161/296] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:40 2022] GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca => generated 1554 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:23:41.326687 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-0cdf4215-cc9f-45f6-b7e5-437ae40c6d21 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:41.328549 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-0cdf4215-cc9f-45f6-b7e5-437ae40c6d21 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: b11929b6-7818-4cae-be4e-8941c93c6aca] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:41.343653 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0cdf4215-cc9f-45f6-b7e5-437ae40c6d21 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:41.344647 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0cdf4215-cc9f-45f6-b7e5-437ae40c6d21 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:41.346313 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0cdf4215-cc9f-45f6-b7e5-437ae40c6d21 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:41.347492 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0cdf4215-cc9f-45f6-b7e5-437ae40c6d21 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:41.511917 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-0cdf4215-cc9f-45f6-b7e5-437ae40c6d21 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.193331 Jul 29 05:23:41.527632 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 162/297] 10.222.0.49 () {58 vars in 1275 bytes} [Fri Jul 29 05:23:41 2022] GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca/os-interface => generated 284 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:23:41.705150 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-350fddd3-5db4-4e11-ae8d-9b8206a4cc4b tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:41.705559 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-350fddd3-5db4-4e11-ae8d-9b8206a4cc4b tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] [instance: f67587cf-7dfb-4577-8512-ef4dc3500073] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:41.713025 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-350fddd3-5db4-4e11-ae8d-9b8206a4cc4b tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:41.713731 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-350fddd3-5db4-4e11-ae8d-9b8206a4cc4b tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:41.715226 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-350fddd3-5db4-4e11-ae8d-9b8206a4cc4b tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:41.715991 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-350fddd3-5db4-4e11-ae8d-9b8206a4cc4b tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:41.789559 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-59eaaebf-8bdd-415f-be3c-c2f761e6443d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:41.804362 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-59eaaebf-8bdd-415f-be3c-c2f761e6443d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20" status: 200 len: 1319 microversion: 2.1 time: 0.602391 Jul 29 05:23:41.806541 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 136/298] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:41 2022] GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20 => generated 1319 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:23:41.935864 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-7277d52b-725f-456f-aa0c-2383a2ae8376 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:41.937994 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-7277d52b-725f-456f-aa0c-2383a2ae8376 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:41.958399 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7277d52b-725f-456f-aa0c-2383a2ae8376 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:41.960922 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7277d52b-725f-456f-aa0c-2383a2ae8376 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:41.962972 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7277d52b-725f-456f-aa0c-2383a2ae8376 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:41.966134 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7277d52b-725f-456f-aa0c-2383a2ae8376 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:42.028836 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-350fddd3-5db4-4e11-ae8d-9b8206a4cc4b tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b335a6ba0400e83608e8a862904ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4804e980ecc84e12a90f01bca1acee0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:42.041908 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-350fddd3-5db4-4e11-ae8d-9b8206a4cc4b tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] 10.222.0.49 "GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073" status: 200 len: 1315 microversion: 2.1 time: 0.342745 Jul 29 05:23:42.043191 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 163/299] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:41 2022] GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073 => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:23:42.049372 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-bff13c6f-7508-457c-9557-aa8207404c20 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:23:42.057244 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bff13c6f-7508-457c-9557-aa8207404c20 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:42.058053 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bff13c6f-7508-457c-9557-aa8207404c20 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:42.178780 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-bff13c6f-7508-457c-9557-aa8207404c20 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Going to try to stop instance {{(pid=117821) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 29 05:23:42.252293 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-bff13c6f-7508-457c-9557-aa8207404c20 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "POST /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba/action" status: 202 len: 0 microversion: 2.1 time: 0.206556 Jul 29 05:23:42.253556 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 164/300] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Jul 29 05:23:42 2022] POST /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 05:23:42.265624 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-64e15094-28c8-43bd-8ed5-35c69ddd3587 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:42.268508 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-64e15094-28c8-43bd-8ed5-35c69ddd3587 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:42.281570 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-64e15094-28c8-43bd-8ed5-35c69ddd3587 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:42.282618 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-64e15094-28c8-43bd-8ed5-35c69ddd3587 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:42.283806 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-64e15094-28c8-43bd-8ed5-35c69ddd3587 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:42.284754 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-64e15094-28c8-43bd-8ed5-35c69ddd3587 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:42.671122 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-7277d52b-725f-456f-aa0c-2383a2ae8376 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:42.681019 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-7277d52b-725f-456f-aa0c-2383a2ae8376 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:42.683592 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-7277d52b-725f-456f-aa0c-2383a2ae8376 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:42.685646 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-7277d52b-725f-456f-aa0c-2383a2ae8376 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1722 microversion: 2.20 time: 0.764624 Jul 29 05:23:42.686242 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 137/301] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:23:41 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1722 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:23:42.707913 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-27810f9e-50fd-4c69-be8b-5a5bde5f4b5c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:42.708953 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-27810f9e-50fd-4c69-be8b-5a5bde5f4b5c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:42.716922 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-27810f9e-50fd-4c69-be8b-5a5bde5f4b5c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:42.717378 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-27810f9e-50fd-4c69-be8b-5a5bde5f4b5c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:42.718176 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-27810f9e-50fd-4c69-be8b-5a5bde5f4b5c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:42.718616 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-27810f9e-50fd-4c69-be8b-5a5bde5f4b5c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:42.975034 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-64e15094-28c8-43bd-8ed5-35c69ddd3587 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:42.991490 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-64e15094-28c8-43bd-8ed5-35c69ddd3587 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1372 microversion: 2.1 time: 0.734790 Jul 29 05:23:43.007392 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 165/302] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:42 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1372 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:43.016720 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-d7fcaf6d-f534-4a23-b608-6d3bef3a29d7 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:43.016720 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-d7fcaf6d-f534-4a23-b608-6d3bef3a29d7 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:43.028889 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d7fcaf6d-f534-4a23-b608-6d3bef3a29d7 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:43.029921 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d7fcaf6d-f534-4a23-b608-6d3bef3a29d7 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:43.031549 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d7fcaf6d-f534-4a23-b608-6d3bef3a29d7 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:43.032457 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d7fcaf6d-f534-4a23-b608-6d3bef3a29d7 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:43.140916 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-27810f9e-50fd-4c69-be8b-5a5bde5f4b5c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:43.157208 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-27810f9e-50fd-4c69-be8b-5a5bde5f4b5c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1723 microversion: 2.1 time: 0.456014 Jul 29 05:23:43.158585 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 138/303] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:42 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1723 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:43.169612 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-c178bdef-1581-4e9a-a62c-cce61a109943 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:43.170303 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-c178bdef-1581-4e9a-a62c-cce61a109943 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] [instance: f67587cf-7dfb-4577-8512-ef4dc3500073] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:43.177602 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c178bdef-1581-4e9a-a62c-cce61a109943 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:43.178341 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c178bdef-1581-4e9a-a62c-cce61a109943 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:43.179327 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c178bdef-1581-4e9a-a62c-cce61a109943 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:43.180050 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c178bdef-1581-4e9a-a62c-cce61a109943 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:43.439073 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-d7fcaf6d-f534-4a23-b608-6d3bef3a29d7 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:43.453418 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-d7fcaf6d-f534-4a23-b608-6d3bef3a29d7 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20" status: 200 len: 1319 microversion: 2.1 time: 0.458156 Jul 29 05:23:43.454433 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 166/304] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:42 2022] GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20 => generated 1319 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:43.464857 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-fa35c8ac-9bc4-479b-a1cc-4dfe0f669124 req-422e87e6-10f2-49bc-a50b-c8a6762687d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00171c99-cf39-4ed6-b78a-3bb24272b171", "tag": "b9da91d9-425e-4a0a-af65-aa645da630ad"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:23:43.525199 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-fa35c8ac-9bc4-479b-a1cc-4dfe0f669124 req-422e87e6-10f2-49bc-a50b-c8a6762687d6 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:43.527133 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-fa35c8ac-9bc4-479b-a1cc-4dfe0f669124 req-422e87e6-10f2-49bc-a50b-c8a6762687d6 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:43.562030 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-fa35c8ac-9bc4-479b-a1cc-4dfe0f669124 req-422e87e6-10f2-49bc-a50b-c8a6762687d6 service nova] Creating event network-changed:b9da91d9-425e-4a0a-af65-aa645da630ad for instance 00171c99-cf39-4ed6-b78a-3bb24272b171 on hv-cinder-85127 Jul 29 05:23:43.567949 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-fa35c8ac-9bc4-479b-a1cc-4dfe0f669124 req-422e87e6-10f2-49bc-a50b-c8a6762687d6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111416 Jul 29 05:23:43.568931 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 167/305] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:23:43.636544 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-156d517c-3d42-4240-b196-0b12eb4c351e req-1ef1a871-d754-4cef-a65d-f39044bade86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b11929b6-7818-4cae-be4e-8941c93c6aca", "tag": "1d1e98d2-d2a2-495e-8225-fe844a178a63"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:23:43.645944 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-156d517c-3d42-4240-b196-0b12eb4c351e req-1ef1a871-d754-4cef-a65d-f39044bade86 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:43.646495 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-156d517c-3d42-4240-b196-0b12eb4c351e req-1ef1a871-d754-4cef-a65d-f39044bade86 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:43.672513 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-156d517c-3d42-4240-b196-0b12eb4c351e req-1ef1a871-d754-4cef-a65d-f39044bade86 service nova] Creating event network-changed:1d1e98d2-d2a2-495e-8225-fe844a178a63 for instance b11929b6-7818-4cae-be4e-8941c93c6aca on hv-cinder-85127 Jul 29 05:23:43.677882 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-156d517c-3d42-4240-b196-0b12eb4c351e req-1ef1a871-d754-4cef-a65d-f39044bade86 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047547 Jul 29 05:23:43.678705 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 168/306] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:23:43.680444 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-c178bdef-1581-4e9a-a62c-cce61a109943 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b335a6ba0400e83608e8a862904ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4804e980ecc84e12a90f01bca1acee0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:43.689707 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-c178bdef-1581-4e9a-a62c-cce61a109943 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] 10.222.0.49 "GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073" status: 200 len: 1315 microversion: 2.1 time: 0.529424 Jul 29 05:23:43.690289 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 139/307] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:43 2022] GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073 => generated 1315 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:43.720373 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-bf282f6b-1a34-473e-931c-5e97768d2286 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:43.721748 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-bf282f6b-1a34-473e-931c-5e97768d2286 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:43.736328 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bf282f6b-1a34-473e-931c-5e97768d2286 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:43.737137 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bf282f6b-1a34-473e-931c-5e97768d2286 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:43.738161 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bf282f6b-1a34-473e-931c-5e97768d2286 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:43.738698 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bf282f6b-1a34-473e-931c-5e97768d2286 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:43.814227 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell0:SELECT=2 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:23:43.974110 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-bf282f6b-1a34-473e-931c-5e97768d2286 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:43.985074 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-bf282f6b-1a34-473e-931c-5e97768d2286 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:43.987469 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-bf282f6b-1a34-473e-931c-5e97768d2286 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:43.988755 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-bf282f6b-1a34-473e-931c-5e97768d2286 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1722 microversion: 2.20 time: 0.277064 Jul 29 05:23:43.989355 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 169/308] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:23:43 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1722 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:23:44.030118 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-65f6d1b1-ee6a-4563-bd34-0ee440f18f74 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:44.031304 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-65f6d1b1-ee6a-4563-bd34-0ee440f18f74 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:44.034580 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell0:SELECT=6 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:23:44.042784 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-65f6d1b1-ee6a-4563-bd34-0ee440f18f74 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:44.043767 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-65f6d1b1-ee6a-4563-bd34-0ee440f18f74 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:44.045353 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-65f6d1b1-ee6a-4563-bd34-0ee440f18f74 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:44.046261 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-65f6d1b1-ee6a-4563-bd34-0ee440f18f74 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:44.180609 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-1bb69e40-431b-42f6-b547-a3305b76890b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:44.181240 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-1bb69e40-431b-42f6-b547-a3305b76890b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:44.192825 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1bb69e40-431b-42f6-b547-a3305b76890b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:44.192825 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1bb69e40-431b-42f6-b547-a3305b76890b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:44.192825 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1bb69e40-431b-42f6-b547-a3305b76890b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:44.193231 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1bb69e40-431b-42f6-b547-a3305b76890b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:44.216257 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:23:44.306512 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-65f6d1b1-ee6a-4563-bd34-0ee440f18f74 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:44.315541 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-65f6d1b1-ee6a-4563-bd34-0ee440f18f74 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1372 microversion: 2.1 time: 0.292213 Jul 29 05:23:44.316127 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 140/309] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:44 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1372 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:44.453492 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-1bb69e40-431b-42f6-b547-a3305b76890b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:44.466126 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-1bb69e40-431b-42f6-b547-a3305b76890b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1723 microversion: 2.1 time: 0.289482 Jul 29 05:23:44.467310 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 170/310] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:44 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1723 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:23:44.507462 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-81df62c7-0a25-4aa9-ac0b-2de316204de9 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:44.508109 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-81df62c7-0a25-4aa9-ac0b-2de316204de9 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:44.511953 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell0:SELECT=24 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:23:44.524461 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-81df62c7-0a25-4aa9-ac0b-2de316204de9 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:44.524996 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-81df62c7-0a25-4aa9-ac0b-2de316204de9 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:44.526232 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-81df62c7-0a25-4aa9-ac0b-2de316204de9 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:44.528455 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-81df62c7-0a25-4aa9-ac0b-2de316204de9 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:44.736876 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-7b7dd578-76fd-4e74-b7d3-be221e386c2b tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:44.738158 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-7b7dd578-76fd-4e74-b7d3-be221e386c2b tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] [instance: f67587cf-7dfb-4577-8512-ef4dc3500073] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:44.742294 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell0:SELECT=16 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:23:44.754513 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7b7dd578-76fd-4e74-b7d3-be221e386c2b tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:44.755164 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7b7dd578-76fd-4e74-b7d3-be221e386c2b tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:44.756799 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7b7dd578-76fd-4e74-b7d3-be221e386c2b tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:44.757607 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7b7dd578-76fd-4e74-b7d3-be221e386c2b tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:45.072126 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-81df62c7-0a25-4aa9-ac0b-2de316204de9 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:45.098110 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-81df62c7-0a25-4aa9-ac0b-2de316204de9 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20" status: 200 len: 1319 microversion: 2.1 time: 0.600028 Jul 29 05:23:45.111878 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 141/311] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:44 2022] GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20 => generated 1319 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:45.130174 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-7b7dd578-76fd-4e74-b7d3-be221e386c2b tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b335a6ba0400e83608e8a862904ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4804e980ecc84e12a90f01bca1acee0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:45.138743 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-0cb315f2-39f3-42d5-88b7-631b7f588be5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:45.140721 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-0cb315f2-39f3-42d5-88b7-631b7f588be5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:45.154562 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-7b7dd578-76fd-4e74-b7d3-be221e386c2b tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] 10.222.0.49 "GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073" status: 200 len: 1465 microversion: 2.1 time: 0.433266 Jul 29 05:23:45.166981 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 171/312] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:44 2022] GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073 => generated 1465 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:23:45.181877 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0cb315f2-39f3-42d5-88b7-631b7f588be5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:45.182956 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0cb315f2-39f3-42d5-88b7-631b7f588be5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:45.186486 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0cb315f2-39f3-42d5-88b7-631b7f588be5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:45.189369 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0cb315f2-39f3-42d5-88b7-631b7f588be5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:45.259962 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-ba680850-5f68-4c28-bf4a-fbf37120b1c4 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:45.261068 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-ba680850-5f68-4c28-bf4a-fbf37120b1c4 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] [instance: f67587cf-7dfb-4577-8512-ef4dc3500073] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:45.277068 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ba680850-5f68-4c28-bf4a-fbf37120b1c4 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:45.278215 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ba680850-5f68-4c28-bf4a-fbf37120b1c4 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:45.278709 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ba680850-5f68-4c28-bf4a-fbf37120b1c4 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:45.279181 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ba680850-5f68-4c28-bf4a-fbf37120b1c4 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:45.336691 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-ba680850-5f68-4c28-bf4a-fbf37120b1c4 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] [instance: f67587cf-7dfb-4577-8512-ef4dc3500073] Going to try to terminate instance {{(pid=117821) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 05:23:45.467138 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-ba680850-5f68-4c28-bf4a-fbf37120b1c4 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073" status: 204 len: 0 microversion: 2.1 time: 0.210571 Jul 29 05:23:45.468279 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 172/313] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 05:23:45 2022] DELETE /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 29 05:23:45.479002 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-d9c03ada-1be4-43c3-8cb1-1a8821cf479b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:45.480631 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-d9c03ada-1be4-43c3-8cb1-1a8821cf479b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:45.490911 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d9c03ada-1be4-43c3-8cb1-1a8821cf479b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:45.491636 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d9c03ada-1be4-43c3-8cb1-1a8821cf479b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:45.492466 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d9c03ada-1be4-43c3-8cb1-1a8821cf479b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:45.492980 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d9c03ada-1be4-43c3-8cb1-1a8821cf479b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:45.558921 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-0cb315f2-39f3-42d5-88b7-631b7f588be5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:45.569999 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-0cb315f2-39f3-42d5-88b7-631b7f588be5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:45.571585 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-0cb315f2-39f3-42d5-88b7-631b7f588be5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:45.572829 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-0cb315f2-39f3-42d5-88b7-631b7f588be5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1722 microversion: 2.20 time: 0.459173 Jul 29 05:23:45.580879 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 142/314] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:23:45 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1722 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:23:45.586344 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-3b993951-c83a-444c-9c8a-1486d89c4dc8 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:45.586957 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-3b993951-c83a-444c-9c8a-1486d89c4dc8 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] [instance: f67587cf-7dfb-4577-8512-ef4dc3500073] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:45.593613 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3b993951-c83a-444c-9c8a-1486d89c4dc8 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:45.594063 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3b993951-c83a-444c-9c8a-1486d89c4dc8 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:45.595078 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3b993951-c83a-444c-9c8a-1486d89c4dc8 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:45.595798 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3b993951-c83a-444c-9c8a-1486d89c4dc8 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:45.710106 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-d9c03ada-1be4-43c3-8cb1-1a8821cf479b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:45.725931 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-d9c03ada-1be4-43c3-8cb1-1a8821cf479b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1372 microversion: 2.1 time: 0.252941 Jul 29 05:23:45.727051 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 173/315] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:45 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1372 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:45.735586 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-cca6bf0f-a640-46b4-af88-4c3280f4d249 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:45.737258 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-cca6bf0f-a640-46b4-af88-4c3280f4d249 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:45.748754 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-cca6bf0f-a640-46b4-af88-4c3280f4d249 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:45.750067 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-cca6bf0f-a640-46b4-af88-4c3280f4d249 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:45.752277 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-cca6bf0f-a640-46b4-af88-4c3280f4d249 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:45.753376 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-cca6bf0f-a640-46b4-af88-4c3280f4d249 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:45.778220 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-3b993951-c83a-444c-9c8a-1486d89c4dc8 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b335a6ba0400e83608e8a862904ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4804e980ecc84e12a90f01bca1acee0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:45.789691 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-3b993951-c83a-444c-9c8a-1486d89c4dc8 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] 10.222.0.49 "GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073" status: 200 len: 1471 microversion: 2.1 time: 0.207366 Jul 29 05:23:45.790757 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 143/316] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:45 2022] GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073 => generated 1471 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:45.797634 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-9d53a443-ecfc-42fc-a54f-968765763370 req-6b2dfe44-69cc-4c12-b97c-bb94069eacec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f803c7a-3603-4d3c-bdcf-67e7f12f1b20", "tag": "7b9f65ae-322a-484b-a4c5-136721870e39"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:23:45.810866 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-9d53a443-ecfc-42fc-a54f-968765763370 req-6b2dfe44-69cc-4c12-b97c-bb94069eacec service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:45.811518 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-9d53a443-ecfc-42fc-a54f-968765763370 req-6b2dfe44-69cc-4c12-b97c-bb94069eacec service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:45.825123 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-9d53a443-ecfc-42fc-a54f-968765763370 req-6b2dfe44-69cc-4c12-b97c-bb94069eacec service nova] Creating event network-changed:7b9f65ae-322a-484b-a4c5-136721870e39 for instance 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20 on hv-cinder-85127 Jul 29 05:23:45.835783 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-9d53a443-ecfc-42fc-a54f-968765763370 req-6b2dfe44-69cc-4c12-b97c-bb94069eacec service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040941 Jul 29 05:23:45.842573 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 144/317] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:23:45.968091 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-cca6bf0f-a640-46b4-af88-4c3280f4d249 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:45.984862 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-cca6bf0f-a640-46b4-af88-4c3280f4d249 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1723 microversion: 2.1 time: 0.255887 Jul 29 05:23:45.985699 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 174/318] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:45 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:46.142729 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-71c57930-396d-4be9-b1bb-19e6bd4ec88c tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:46.144177 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-71c57930-396d-4be9-b1bb-19e6bd4ec88c tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:46.157893 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-71c57930-396d-4be9-b1bb-19e6bd4ec88c tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:46.158695 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-71c57930-396d-4be9-b1bb-19e6bd4ec88c tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:46.160449 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-71c57930-396d-4be9-b1bb-19e6bd4ec88c tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:46.161208 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-71c57930-396d-4be9-b1bb-19e6bd4ec88c tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:46.360033 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-71c57930-396d-4be9-b1bb-19e6bd4ec88c tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:46.368218 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-71c57930-396d-4be9-b1bb-19e6bd4ec88c tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20" status: 200 len: 1319 microversion: 2.1 time: 0.233508 Jul 29 05:23:46.368940 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 145/319] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:46 2022] GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20 => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:46.599606 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-3d6d65bc-1ac1-4557-afd5-d0deb96ba25b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:46.600426 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-3d6d65bc-1ac1-4557-afd5-d0deb96ba25b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:46.609215 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3d6d65bc-1ac1-4557-afd5-d0deb96ba25b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:46.609685 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3d6d65bc-1ac1-4557-afd5-d0deb96ba25b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:46.610574 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3d6d65bc-1ac1-4557-afd5-d0deb96ba25b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:46.611027 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3d6d65bc-1ac1-4557-afd5-d0deb96ba25b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:46.761413 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-b8b2f4f5-3323-4db3-8ac9-d7d3b9cab24d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:46.762221 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-b8b2f4f5-3323-4db3-8ac9-d7d3b9cab24d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:46.768977 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b8b2f4f5-3323-4db3-8ac9-d7d3b9cab24d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:46.769712 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b8b2f4f5-3323-4db3-8ac9-d7d3b9cab24d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:46.770501 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b8b2f4f5-3323-4db3-8ac9-d7d3b9cab24d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:46.771117 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b8b2f4f5-3323-4db3-8ac9-d7d3b9cab24d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:46.777760 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-3d6d65bc-1ac1-4557-afd5-d0deb96ba25b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:46.803263 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-3d6d65bc-1ac1-4557-afd5-d0deb96ba25b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:46.804928 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-3d6d65bc-1ac1-4557-afd5-d0deb96ba25b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:46.807056 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-3d6d65bc-1ac1-4557-afd5-d0deb96ba25b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1722 microversion: 2.20 time: 0.211536 Jul 29 05:23:46.807682 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 175/320] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:23:46 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:23:46.821145 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-a5fc0dcc-73d3-4ee2-91f0-f686429cd226 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:46.822201 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-a5fc0dcc-73d3-4ee2-91f0-f686429cd226 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] [instance: f67587cf-7dfb-4577-8512-ef4dc3500073] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:46.840665 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a5fc0dcc-73d3-4ee2-91f0-f686429cd226 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:46.841205 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a5fc0dcc-73d3-4ee2-91f0-f686429cd226 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:46.842021 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a5fc0dcc-73d3-4ee2-91f0-f686429cd226 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:46.842461 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a5fc0dcc-73d3-4ee2-91f0-f686429cd226 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:46.981842 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-b8b2f4f5-3323-4db3-8ac9-d7d3b9cab24d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:46.991318 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-b8b2f4f5-3323-4db3-8ac9-d7d3b9cab24d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1372 microversion: 2.1 time: 0.233863 Jul 29 05:23:46.992277 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 146/321] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:46 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1372 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:47.012021 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-a5fc0dcc-73d3-4ee2-91f0-f686429cd226 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b335a6ba0400e83608e8a862904ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4804e980ecc84e12a90f01bca1acee0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:47.022245 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-0c70f9db-6929-4992-afd1-b5160986c380 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:47.023405 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-0c70f9db-6929-4992-afd1-b5160986c380 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:47.038552 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-a5fc0dcc-73d3-4ee2-91f0-f686429cd226 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] 10.222.0.49 "GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073" status: 200 len: 1471 microversion: 2.1 time: 0.208623 Jul 29 05:23:47.038552 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 176/322] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:46 2022] GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073 => generated 1471 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:23:47.039002 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0c70f9db-6929-4992-afd1-b5160986c380 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:47.039002 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0c70f9db-6929-4992-afd1-b5160986c380 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:47.039002 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0c70f9db-6929-4992-afd1-b5160986c380 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:47.039002 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0c70f9db-6929-4992-afd1-b5160986c380 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:47.202731 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-0c70f9db-6929-4992-afd1-b5160986c380 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:47.211658 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-0c70f9db-6929-4992-afd1-b5160986c380 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1723 microversion: 2.1 time: 0.196207 Jul 29 05:23:47.212261 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 147/323] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:47 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:47.398421 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-b284bcda-885d-4d86-955c-231ae7cea2f1 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:47.399453 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-b284bcda-885d-4d86-955c-231ae7cea2f1 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:47.406574 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b284bcda-885d-4d86-955c-231ae7cea2f1 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:47.407032 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b284bcda-885d-4d86-955c-231ae7cea2f1 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:47.407889 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b284bcda-885d-4d86-955c-231ae7cea2f1 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:47.408323 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b284bcda-885d-4d86-955c-231ae7cea2f1 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:47.579878 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-b284bcda-885d-4d86-955c-231ae7cea2f1 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:47.593898 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-b284bcda-885d-4d86-955c-231ae7cea2f1 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20" status: 200 len: 1319 microversion: 2.1 time: 0.199444 Jul 29 05:23:47.594588 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 177/324] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:47 2022] GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:47.841111 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-65c24523-0546-4c90-86e5-b0fdf9608883 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:47.841761 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-65c24523-0546-4c90-86e5-b0fdf9608883 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:47.849144 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-65c24523-0546-4c90-86e5-b0fdf9608883 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:47.849600 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-65c24523-0546-4c90-86e5-b0fdf9608883 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:47.850379 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-65c24523-0546-4c90-86e5-b0fdf9608883 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:47.850822 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-65c24523-0546-4c90-86e5-b0fdf9608883 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:47.854198 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell1:SELECT=100 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:23:48.013293 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-8a1adcfc-3344-4ecc-a9af-3d2619ee0b27 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:48.013924 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-8a1adcfc-3344-4ecc-a9af-3d2619ee0b27 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:48.014997 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-65c24523-0546-4c90-86e5-b0fdf9608883 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:48.020949 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8a1adcfc-3344-4ecc-a9af-3d2619ee0b27 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:48.021398 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8a1adcfc-3344-4ecc-a9af-3d2619ee0b27 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:48.022381 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8a1adcfc-3344-4ecc-a9af-3d2619ee0b27 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:48.022814 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8a1adcfc-3344-4ecc-a9af-3d2619ee0b27 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:48.037898 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-65c24523-0546-4c90-86e5-b0fdf9608883 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:48.040176 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-65c24523-0546-4c90-86e5-b0fdf9608883 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:48.041632 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-65c24523-0546-4c90-86e5-b0fdf9608883 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1722 microversion: 2.20 time: 0.204644 Jul 29 05:23:48.053180 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 148/325] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:23:47 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:23:48.057792 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-bd91c66f-c425-4a14-9dbb-f43c12602451 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:48.058426 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-bd91c66f-c425-4a14-9dbb-f43c12602451 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] [instance: f67587cf-7dfb-4577-8512-ef4dc3500073] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:48.066463 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bd91c66f-c425-4a14-9dbb-f43c12602451 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:48.067174 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bd91c66f-c425-4a14-9dbb-f43c12602451 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:48.068189 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bd91c66f-c425-4a14-9dbb-f43c12602451 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:48.068800 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bd91c66f-c425-4a14-9dbb-f43c12602451 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:48.204671 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-8a1adcfc-3344-4ecc-a9af-3d2619ee0b27 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:48.226673 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-8a1adcfc-3344-4ecc-a9af-3d2619ee0b27 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1372 microversion: 2.1 time: 0.217646 Jul 29 05:23:48.227577 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 178/326] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:48 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1372 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:23:48.239614 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-04204a3d-ebfa-4d0b-b5eb-c1531b2e2a9a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:48.240234 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-04204a3d-ebfa-4d0b-b5eb-c1531b2e2a9a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:48.246964 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-04204a3d-ebfa-4d0b-b5eb-c1531b2e2a9a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:48.247649 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-04204a3d-ebfa-4d0b-b5eb-c1531b2e2a9a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:48.248423 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-04204a3d-ebfa-4d0b-b5eb-c1531b2e2a9a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:48.248857 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-04204a3d-ebfa-4d0b-b5eb-c1531b2e2a9a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:48.249260 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-bd91c66f-c425-4a14-9dbb-f43c12602451 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b335a6ba0400e83608e8a862904ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4804e980ecc84e12a90f01bca1acee0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:48.257636 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-bd91c66f-c425-4a14-9dbb-f43c12602451 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] 10.222.0.49 "GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073" status: 200 len: 1471 microversion: 2.1 time: 0.203596 Jul 29 05:23:48.258332 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 149/327] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:48 2022] GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073 => generated 1471 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:48.409913 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-04204a3d-ebfa-4d0b-b5eb-c1531b2e2a9a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:48.428234 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-04204a3d-ebfa-4d0b-b5eb-c1531b2e2a9a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1723 microversion: 2.1 time: 0.192454 Jul 29 05:23:48.428854 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 179/328] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:48 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:48.615978 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-cadc086b-658a-4def-a2aa-7d5ef7e040d5 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:48.616588 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-cadc086b-658a-4def-a2aa-7d5ef7e040d5 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:48.624171 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-cadc086b-658a-4def-a2aa-7d5ef7e040d5 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:48.624624 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-cadc086b-658a-4def-a2aa-7d5ef7e040d5 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:48.625407 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-cadc086b-658a-4def-a2aa-7d5ef7e040d5 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:48.626098 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-cadc086b-658a-4def-a2aa-7d5ef7e040d5 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:48.782811 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-cadc086b-658a-4def-a2aa-7d5ef7e040d5 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:48.799224 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-cadc086b-658a-4def-a2aa-7d5ef7e040d5 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20" status: 200 len: 1319 microversion: 2.1 time: 0.186893 Jul 29 05:23:48.799885 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 150/329] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:48 2022] GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:49.065670 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-b8853482-0dda-4d1a-bc93-d53a6f5e827c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:49.066574 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-b8853482-0dda-4d1a-bc93-d53a6f5e827c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:49.075744 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b8853482-0dda-4d1a-bc93-d53a6f5e827c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:49.076210 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b8853482-0dda-4d1a-bc93-d53a6f5e827c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:49.077395 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b8853482-0dda-4d1a-bc93-d53a6f5e827c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:49.077521 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b8853482-0dda-4d1a-bc93-d53a6f5e827c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:49.261034 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-29ef5597-cabd-46fc-b565-3940400b2485 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:49.261879 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-29ef5597-cabd-46fc-b565-3940400b2485 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:49.268043 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-b8853482-0dda-4d1a-bc93-d53a6f5e827c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:49.269916 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-29ef5597-cabd-46fc-b565-3940400b2485 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:49.270567 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-29ef5597-cabd-46fc-b565-3940400b2485 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:49.271412 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-29ef5597-cabd-46fc-b565-3940400b2485 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:49.272277 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-29ef5597-cabd-46fc-b565-3940400b2485 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:49.280189 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-b8853482-0dda-4d1a-bc93-d53a6f5e827c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:49.283800 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-b8853482-0dda-4d1a-bc93-d53a6f5e827c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:49.286857 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-b8853482-0dda-4d1a-bc93-d53a6f5e827c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1722 microversion: 2.20 time: 0.224884 Jul 29 05:23:49.288236 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 180/330] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:23:49 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:23:49.294406 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-fee1f16e-364a-49fd-97ad-6cb045ee4791 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:49.295690 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-fee1f16e-364a-49fd-97ad-6cb045ee4791 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] [instance: f67587cf-7dfb-4577-8512-ef4dc3500073] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:49.308279 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-fee1f16e-364a-49fd-97ad-6cb045ee4791 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:49.309593 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-fee1f16e-364a-49fd-97ad-6cb045ee4791 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:49.312800 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-fee1f16e-364a-49fd-97ad-6cb045ee4791 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:49.313709 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-fee1f16e-364a-49fd-97ad-6cb045ee4791 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:49.499987 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-fee1f16e-364a-49fd-97ad-6cb045ee4791 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b335a6ba0400e83608e8a862904ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4804e980ecc84e12a90f01bca1acee0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:49.514434 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-fee1f16e-364a-49fd-97ad-6cb045ee4791 tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] 10.222.0.49 "GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073" status: 200 len: 1471 microversion: 2.1 time: 0.224247 Jul 29 05:23:49.516445 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 181/331] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:49 2022] GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073 => generated 1471 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:49.524226 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-8abbd9b3-a0bc-4529-8daf-26378ab40d79 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:49.525351 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-8abbd9b3-a0bc-4529-8daf-26378ab40d79 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:49.536549 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8abbd9b3-a0bc-4529-8daf-26378ab40d79 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:49.537373 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8abbd9b3-a0bc-4529-8daf-26378ab40d79 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:49.538733 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8abbd9b3-a0bc-4529-8daf-26378ab40d79 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:49.539664 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8abbd9b3-a0bc-4529-8daf-26378ab40d79 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:49.730938 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-8abbd9b3-a0bc-4529-8daf-26378ab40d79 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:49.745401 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-8abbd9b3-a0bc-4529-8daf-26378ab40d79 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1723 microversion: 2.1 time: 0.227752 Jul 29 05:23:49.746281 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 182/332] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:49 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:49.822405 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-520f07c4-131e-4ace-acfc-efee2e3fb251 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:49.824012 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-520f07c4-131e-4ace-acfc-efee2e3fb251 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:49.831129 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-520f07c4-131e-4ace-acfc-efee2e3fb251 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:49.831776 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-520f07c4-131e-4ace-acfc-efee2e3fb251 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:49.833247 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-520f07c4-131e-4ace-acfc-efee2e3fb251 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:49.833882 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-520f07c4-131e-4ace-acfc-efee2e3fb251 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:49.972754 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-29ef5597-cabd-46fc-b565-3940400b2485 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:49.982217 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-29ef5597-cabd-46fc-b565-3940400b2485 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1372 microversion: 2.1 time: 0.726648 Jul 29 05:23:49.996053 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 151/333] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:49 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1372 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:50.041019 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-520f07c4-131e-4ace-acfc-efee2e3fb251 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:50.050065 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-520f07c4-131e-4ace-acfc-efee2e3fb251 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20" status: 200 len: 1319 microversion: 2.1 time: 0.231326 Jul 29 05:23:50.051019 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 183/334] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:49 2022] GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:23:50.322340 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-e716075b-3263-4604-8b9b-25b1d4f227f9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:50.323128 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-e716075b-3263-4604-8b9b-25b1d4f227f9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:50.332017 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e716075b-3263-4604-8b9b-25b1d4f227f9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:50.332539 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e716075b-3263-4604-8b9b-25b1d4f227f9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:50.333367 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e716075b-3263-4604-8b9b-25b1d4f227f9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:50.333808 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e716075b-3263-4604-8b9b-25b1d4f227f9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:50.563393 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-4369edb3-c660-449a-9696-507fa341531c tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:50.565993 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-4369edb3-c660-449a-9696-507fa341531c tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] [instance: f67587cf-7dfb-4577-8512-ef4dc3500073] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:50.583684 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4369edb3-c660-449a-9696-507fa341531c tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:50.585231 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4369edb3-c660-449a-9696-507fa341531c tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:50.587056 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4369edb3-c660-449a-9696-507fa341531c tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:50.588533 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4369edb3-c660-449a-9696-507fa341531c tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:50.811750 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-e716075b-3263-4604-8b9b-25b1d4f227f9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:50.830505 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-e716075b-3263-4604-8b9b-25b1d4f227f9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:50.833387 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-e716075b-3263-4604-8b9b-25b1d4f227f9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:50.836056 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-e716075b-3263-4604-8b9b-25b1d4f227f9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1722 microversion: 2.20 time: 0.519135 Jul 29 05:23:50.843579 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 152/335] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:23:50 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1722 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:23:50.856163 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-0a88bf35-0f23-4eb8-ba59-a08ebe871b66 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:50.857380 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-0a88bf35-0f23-4eb8-ba59-a08ebe871b66 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:50.865542 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0a88bf35-0f23-4eb8-ba59-a08ebe871b66 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:50.866658 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0a88bf35-0f23-4eb8-ba59-a08ebe871b66 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:50.868139 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0a88bf35-0f23-4eb8-ba59-a08ebe871b66 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:50.871779 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0a88bf35-0f23-4eb8-ba59-a08ebe871b66 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:50.970417 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-4369edb3-c660-449a-9696-507fa341531c tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b335a6ba0400e83608e8a862904ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4804e980ecc84e12a90f01bca1acee0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:50.980403 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-4369edb3-c660-449a-9696-507fa341531c tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] 10.222.0.49 "GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073" status: 200 len: 1471 microversion: 2.1 time: 0.427961 Jul 29 05:23:50.981841 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 184/336] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:50 2022] GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073 => generated 1471 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:51.006246 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-eff33a65-50fe-453f-a96f-15d0c99a9b67 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:51.006909 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-eff33a65-50fe-453f-a96f-15d0c99a9b67 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:51.014890 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-eff33a65-50fe-453f-a96f-15d0c99a9b67 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:51.015340 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-eff33a65-50fe-453f-a96f-15d0c99a9b67 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:51.016405 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-eff33a65-50fe-453f-a96f-15d0c99a9b67 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:51.016847 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-eff33a65-50fe-453f-a96f-15d0c99a9b67 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:51.039835 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:23:51.259302 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-0a88bf35-0f23-4eb8-ba59-a08ebe871b66 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:51.266149 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-eff33a65-50fe-453f-a96f-15d0c99a9b67 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:51.274865 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-eff33a65-50fe-453f-a96f-15d0c99a9b67 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1372 microversion: 2.1 time: 0.274275 Jul 29 05:23:51.287240 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 185/337] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:50 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1372 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:23:51.294507 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-0a88bf35-0f23-4eb8-ba59-a08ebe871b66 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1723 microversion: 2.1 time: 0.448734 Jul 29 05:23:51.295662 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 153/338] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:50 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1723 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:51.299815 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-d3e51919-f477-45f5-bde0-c7f966a81722 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:51.301004 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-d3e51919-f477-45f5-bde0-c7f966a81722 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:51.309863 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-d6b341db-cb43-4b59-a883-c3e2c030a52f req-4c76d7f5-0138-4f8a-9bad-36f024f50cdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f67587cf-7dfb-4577-8512-ef4dc3500073", "name": "network-vif-deleted", "tag": "8628c596-8348-4bfe-bb55-d19280454b65"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:23:51.325515 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-d6b341db-cb43-4b59-a883-c3e2c030a52f req-4c76d7f5-0138-4f8a-9bad-36f024f50cdd service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:51.326733 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d3e51919-f477-45f5-bde0-c7f966a81722 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:51.327041 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-d6b341db-cb43-4b59-a883-c3e2c030a52f req-4c76d7f5-0138-4f8a-9bad-36f024f50cdd service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:51.327520 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d3e51919-f477-45f5-bde0-c7f966a81722 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:51.327810 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d3e51919-f477-45f5-bde0-c7f966a81722 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:51.328555 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d3e51919-f477-45f5-bde0-c7f966a81722 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:51.342188 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-d6b341db-cb43-4b59-a883-c3e2c030a52f req-4c76d7f5-0138-4f8a-9bad-36f024f50cdd service nova] Creating event network-vif-deleted:8628c596-8348-4bfe-bb55-d19280454b65 for instance f67587cf-7dfb-4577-8512-ef4dc3500073 on hv-cinder-85127 Jul 29 05:23:51.348504 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-d6b341db-cb43-4b59-a883-c3e2c030a52f req-4c76d7f5-0138-4f8a-9bad-36f024f50cdd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050609 Jul 29 05:23:51.349835 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 154/339] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:23:51.532563 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-d3e51919-f477-45f5-bde0-c7f966a81722 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:51.541478 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-d3e51919-f477-45f5-bde0-c7f966a81722 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20" status: 200 len: 1319 microversion: 2.1 time: 0.248775 Jul 29 05:23:51.542147 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 186/340] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:51 2022] GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20 => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:51.873330 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-71b323a0-1965-4188-b7ea-216d9933fb50 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:51.874931 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-71b323a0-1965-4188-b7ea-216d9933fb50 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:51.891160 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-71b323a0-1965-4188-b7ea-216d9933fb50 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:51.892080 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-71b323a0-1965-4188-b7ea-216d9933fb50 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:51.893937 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-71b323a0-1965-4188-b7ea-216d9933fb50 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:51.894691 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-71b323a0-1965-4188-b7ea-216d9933fb50 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:52.005604 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-7851209a-d859-4c15-83bc-256f6af4012d tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:52.006429 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-7851209a-d859-4c15-83bc-256f6af4012d tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] [instance: f67587cf-7dfb-4577-8512-ef4dc3500073] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:52.015736 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7851209a-d859-4c15-83bc-256f6af4012d tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:52.016344 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7851209a-d859-4c15-83bc-256f6af4012d tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:52.019000 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7851209a-d859-4c15-83bc-256f6af4012d tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:52.019662 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7851209a-d859-4c15-83bc-256f6af4012d tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:52.067189 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.wsgi [None req-7851209a-d859-4c15-83bc-256f6af4012d tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] HTTP exception thrown: Instance f67587cf-7dfb-4577-8512-ef4dc3500073 could not be found. Jul 29 05:23:52.069057 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-7851209a-d859-4c15-83bc-256f6af4012d tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Request method failure captured: Jul 29 05:23:52.069057 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: request: GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073 HTTP/1.1 Jul 29 05:23:52.069057 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept: application/json Jul 29 05:23:52.069057 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept-Encoding: identity Jul 29 05:23:52.069057 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Connection: close Jul 29 05:23:52.069057 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Length: 0 Jul 29 05:23:52.069057 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Type: application/json Jul 29 05:23:52.069057 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Host: 10.222.0.49 Jul 29 05:23:52.069057 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Openstack-System-Scope: None Jul 29 05:23:52.069057 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: User-Agent: python-urllib3/1.26.10 Jul 29 05:23:52.069057 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Auth-Token: gAAAAABi427IBJq0SYJEXEe7Zu5v892sHTyGGnu1LhNdD2B0wZozUB40rLHoy7ZgpJGl1HXWQEl3rOdQB-xEt_qQ80JNQgoiioKtnputONcVuI9y8BUAVGI8n4MYRN1dZ4MNvcKZNRjqI56KO_3--YY9kSnXZ7a86ao11Bf2QaCUcCurWwpxSQU Jul 29 05:23:52.069057 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Id: None Jul 29 05:23:52.069057 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Name: None Jul 29 05:23:52.069057 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Identity-Status: Confirmed Jul 29 05:23:52.069057 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Is-Admin-Project: True Jul 29 05:23:52.069057 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Id: default Jul 29 05:23:52.069057 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Name: Default Jul 29 05:23:52.069057 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Id: 4804e980ecc84e12a90f01bca1acee0a Jul 29 05:23:52.069057 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Name: tempest-VolumesNegativeTest-1036128200 Jul 29 05:23:52.069057 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Role: member,reader Jul 29 05:23:52.069057 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Roles: member,reader Jul 29 05:23:52.070372 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4804e980ecc84e12a90f01bca1acee0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4804e980ecc84e12a90f01bca1acee0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4804e980ecc84e12a90f01bca1acee0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4804e980ecc84e12a90f01bca1acee0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:23:52.070372 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant: tempest-VolumesNegativeTest-1036128200 Jul 29 05:23:52.070372 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Id: 4804e980ecc84e12a90f01bca1acee0a Jul 29 05:23:52.070372 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Name: tempest-VolumesNegativeTest-1036128200 Jul 29 05:23:52.070372 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User: tempest-VolumesNegativeTest-1036128200-project Jul 29 05:23:52.070372 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Id: default Jul 29 05:23:52.070372 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Name: Default Jul 29 05:23:52.070372 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Id: 073b335a6ba0400e83608e8a862904ee Jul 29 05:23:52.070372 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Name: tempest-VolumesNegativeTest-1036128200-project Jul 29 05:23:52.070372 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: method: > Jul 29 05:23:52.070372 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: exception: Instance f67587cf-7dfb-4577-8512-ef4dc3500073 could not be found. Jul 29 05:23:52.070372 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: action_args: {'id': 'f67587cf-7dfb-4577-8512-ef4dc3500073'} Jul 29 05:23:52.071303 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:23:52.071303 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:23:52.071303 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:23:52.071303 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:23:52.071303 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:23:52.071303 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:23:52.071303 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:23:52.071303 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:23:52.071303 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:23:52.071303 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:23:52.071303 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f67587cf-7dfb-4577-8512-ef4dc3500073 could not be found. Jul 29 05:23:52.071303 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:23:52.071303 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:23:52.071303 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:23:52.071303 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:23:52.071303 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:23:52.071303 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:23:52.071303 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:23:52.071303 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:23:52.071303 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:23:52.072667 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:23:52.072667 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:23:52.072667 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:23:52.072667 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:23:52.072667 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:23:52.072667 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:23:52.072667 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:23:52.072667 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f67587cf-7dfb-4577-8512-ef4dc3500073 could not be found. Jul 29 05:23:52.072667 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:23:52.072667 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:23:52.072667 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:23:52.072667 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:23:52.072667 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:23:52.072667 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:23:52.072667 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:23:52.072667 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:23:52.072667 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f67587cf-7dfb-4577-8512-ef4dc3500073 could not be found. Jul 29 05:23:52.072667 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:23:52.073767 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-7851209a-d859-4c15-83bc-256f6af4012d tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] Returning 404 to user: Instance f67587cf-7dfb-4577-8512-ef4dc3500073 could not be found. {{(pid=117821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:23:52.073767 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-7851209a-d859-4c15-83bc-256f6af4012d tempest-VolumesNegativeTest-1036128200 tempest-VolumesNegativeTest-1036128200-project] 10.222.0.49 "GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073" status: 404 len: 111 microversion: 2.1 time: 0.069200 Jul 29 05:23:52.077118 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 187/341] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:52 2022] GET /compute/v2.1/servers/f67587cf-7dfb-4577-8512-ef4dc3500073 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 05:23:52.196475 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-71b323a0-1965-4188-b7ea-216d9933fb50 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:52.215537 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-71b323a0-1965-4188-b7ea-216d9933fb50 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:52.217300 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-71b323a0-1965-4188-b7ea-216d9933fb50 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:52.218919 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-71b323a0-1965-4188-b7ea-216d9933fb50 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1722 microversion: 2.20 time: 0.356773 Jul 29 05:23:52.219934 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 155/342] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:23:51 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1722 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:23:52.306131 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-49da6fe5-a931-4f70-8f84-2cff90172909 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:52.306809 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-49da6fe5-a931-4f70-8f84-2cff90172909 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:52.314878 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-49da6fe5-a931-4f70-8f84-2cff90172909 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:52.315327 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-49da6fe5-a931-4f70-8f84-2cff90172909 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:52.316808 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-49da6fe5-a931-4f70-8f84-2cff90172909 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:52.317849 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-49da6fe5-a931-4f70-8f84-2cff90172909 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:52.329120 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-091d99c6-a1f2-498a-85f3-7aa5aeb4ff63 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:52.330997 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-091d99c6-a1f2-498a-85f3-7aa5aeb4ff63 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:52.353950 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-091d99c6-a1f2-498a-85f3-7aa5aeb4ff63 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:52.358148 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-091d99c6-a1f2-498a-85f3-7aa5aeb4ff63 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:52.360084 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-091d99c6-a1f2-498a-85f3-7aa5aeb4ff63 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:52.362828 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-091d99c6-a1f2-498a-85f3-7aa5aeb4ff63 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:52.582410 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-49da6fe5-a931-4f70-8f84-2cff90172909 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:52.592586 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-49da6fe5-a931-4f70-8f84-2cff90172909 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1372 microversion: 2.1 time: 0.295970 Jul 29 05:23:52.593301 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 188/343] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:52 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1372 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:52.612518 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-b377fc64-142f-455b-976c-cc7037d9544d req-75fb8227-0fc0-48e0-8ef8-7ea2e82aff5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00171c99-cf39-4ed6-b78a-3bb24272b171", "name": "network-vif-plugged", "status": "completed", "tag": "b9da91d9-425e-4a0a-af65-aa645da630ad"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:23:52.623936 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-b377fc64-142f-455b-976c-cc7037d9544d req-75fb8227-0fc0-48e0-8ef8-7ea2e82aff5f service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:52.624485 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-b377fc64-142f-455b-976c-cc7037d9544d req-75fb8227-0fc0-48e0-8ef8-7ea2e82aff5f service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:52.637493 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-b377fc64-142f-455b-976c-cc7037d9544d req-75fb8227-0fc0-48e0-8ef8-7ea2e82aff5f service nova] Creating event network-vif-plugged:b9da91d9-425e-4a0a-af65-aa645da630ad for instance 00171c99-cf39-4ed6-b78a-3bb24272b171 on hv-cinder-85127 Jul 29 05:23:52.644179 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-b377fc64-142f-455b-976c-cc7037d9544d req-75fb8227-0fc0-48e0-8ef8-7ea2e82aff5f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035365 Jul 29 05:23:52.644907 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 189/344] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:23:52.656826 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-04522625-1e56-4bd4-8ee1-dde6fe3cd1cc tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:52.657093 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-091d99c6-a1f2-498a-85f3-7aa5aeb4ff63 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:52.658255 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-04522625-1e56-4bd4-8ee1-dde6fe3cd1cc tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:52.677980 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-091d99c6-a1f2-498a-85f3-7aa5aeb4ff63 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1723 microversion: 2.1 time: 0.356490 Jul 29 05:23:52.678633 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 156/345] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:52 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1723 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:23:52.691855 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-04522625-1e56-4bd4-8ee1-dde6fe3cd1cc tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:52.691855 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-04522625-1e56-4bd4-8ee1-dde6fe3cd1cc tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:52.691855 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-04522625-1e56-4bd4-8ee1-dde6fe3cd1cc tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:52.691855 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-04522625-1e56-4bd4-8ee1-dde6fe3cd1cc tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:52.892247 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-04522625-1e56-4bd4-8ee1-dde6fe3cd1cc tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:52.913477 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-04522625-1e56-4bd4-8ee1-dde6fe3cd1cc tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20" status: 200 len: 1319 microversion: 2.1 time: 0.262422 Jul 29 05:23:52.914398 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 190/346] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:52 2022] GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20 => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:53.244976 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-15b427b1-23fe-410d-bbab-f38c3114e057 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:53.246097 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-15b427b1-23fe-410d-bbab-f38c3114e057 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:53.255540 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-15b427b1-23fe-410d-bbab-f38c3114e057 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:53.256011 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-15b427b1-23fe-410d-bbab-f38c3114e057 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:53.257074 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-15b427b1-23fe-410d-bbab-f38c3114e057 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:53.257712 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-15b427b1-23fe-410d-bbab-f38c3114e057 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:53.458024 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-15b427b1-23fe-410d-bbab-f38c3114e057 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:53.468562 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-15b427b1-23fe-410d-bbab-f38c3114e057 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:53.470210 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-15b427b1-23fe-410d-bbab-f38c3114e057 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:53.471603 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-15b427b1-23fe-410d-bbab-f38c3114e057 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1722 microversion: 2.20 time: 0.231344 Jul 29 05:23:53.475765 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 157/347] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:23:53 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:23:53.620579 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-de0d155b-0a1d-4fd7-b1cc-7e7c0739e9e8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:53.621870 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-de0d155b-0a1d-4fd7-b1cc-7e7c0739e9e8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:53.626545 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:23:53.632274 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-de0d155b-0a1d-4fd7-b1cc-7e7c0739e9e8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:53.633100 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-de0d155b-0a1d-4fd7-b1cc-7e7c0739e9e8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:53.634422 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-de0d155b-0a1d-4fd7-b1cc-7e7c0739e9e8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:53.635928 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-de0d155b-0a1d-4fd7-b1cc-7e7c0739e9e8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:53.702368 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-dec54786-8b8e-484e-a743-273e53f840e3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:53.703190 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-dec54786-8b8e-484e-a743-273e53f840e3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:53.710665 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-dec54786-8b8e-484e-a743-273e53f840e3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:53.711118 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-dec54786-8b8e-484e-a743-273e53f840e3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:53.712907 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-dec54786-8b8e-484e-a743-273e53f840e3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:53.714651 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-dec54786-8b8e-484e-a743-273e53f840e3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:53.837099 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-de0d155b-0a1d-4fd7-b1cc-7e7c0739e9e8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:53.848509 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-de0d155b-0a1d-4fd7-b1cc-7e7c0739e9e8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1372 microversion: 2.1 time: 0.235638 Jul 29 05:23:53.849954 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 191/348] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:53 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1372 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:53.940674 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-74e9e435-eb05-4ccc-9052-2c0d33ae8f2a tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:53.941430 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-74e9e435-eb05-4ccc-9052-2c0d33ae8f2a tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:53.955093 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-74e9e435-eb05-4ccc-9052-2c0d33ae8f2a tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:53.955741 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-74e9e435-eb05-4ccc-9052-2c0d33ae8f2a tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:53.958162 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-74e9e435-eb05-4ccc-9052-2c0d33ae8f2a tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:53.958909 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-74e9e435-eb05-4ccc-9052-2c0d33ae8f2a tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:54.000797 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-dec54786-8b8e-484e-a743-273e53f840e3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:54.013636 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-dec54786-8b8e-484e-a743-273e53f840e3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1723 microversion: 2.1 time: 0.316476 Jul 29 05:23:54.014941 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 158/349] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:53 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1723 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:54.282704 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-74e9e435-eb05-4ccc-9052-2c0d33ae8f2a tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:54.302003 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-74e9e435-eb05-4ccc-9052-2c0d33ae8f2a tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20" status: 200 len: 1319 microversion: 2.1 time: 0.367413 Jul 29 05:23:54.304094 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 192/350] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:53 2022] GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20 => generated 1319 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:54.502486 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-8002719e-c711-481c-9ad8-b3e9ae9b7da2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:54.504743 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-8002719e-c711-481c-9ad8-b3e9ae9b7da2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:54.517463 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8002719e-c711-481c-9ad8-b3e9ae9b7da2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:54.519749 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8002719e-c711-481c-9ad8-b3e9ae9b7da2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:54.522295 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8002719e-c711-481c-9ad8-b3e9ae9b7da2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:54.523286 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8002719e-c711-481c-9ad8-b3e9ae9b7da2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:54.671861 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-5e2df50e-8ffb-4e4a-87f6-9440d6b4f1e2 req-52d887eb-6f8d-4c9f-9f44-0e8ef4382ebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f803c7a-3603-4d3c-bdcf-67e7f12f1b20", "name": "network-vif-plugged", "status": "completed", "tag": "7b9f65ae-322a-484b-a4c5-136721870e39"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:23:54.685491 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-5e2df50e-8ffb-4e4a-87f6-9440d6b4f1e2 req-52d887eb-6f8d-4c9f-9f44-0e8ef4382ebd service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:54.686441 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-5e2df50e-8ffb-4e4a-87f6-9440d6b4f1e2 req-52d887eb-6f8d-4c9f-9f44-0e8ef4382ebd service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:54.701933 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-5e2df50e-8ffb-4e4a-87f6-9440d6b4f1e2 req-52d887eb-6f8d-4c9f-9f44-0e8ef4382ebd service nova] Creating event network-vif-plugged:7b9f65ae-322a-484b-a4c5-136721870e39 for instance 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20 on hv-cinder-85127 Jul 29 05:23:54.707643 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-5e2df50e-8ffb-4e4a-87f6-9440d6b4f1e2 req-52d887eb-6f8d-4c9f-9f44-0e8ef4382ebd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041395 Jul 29 05:23:54.709007 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 193/351] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:23:54.744071 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-8002719e-c711-481c-9ad8-b3e9ae9b7da2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:54.755012 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-8002719e-c711-481c-9ad8-b3e9ae9b7da2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:54.757153 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-8002719e-c711-481c-9ad8-b3e9ae9b7da2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:54.758596 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-8002719e-c711-481c-9ad8-b3e9ae9b7da2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1722 microversion: 2.20 time: 0.265439 Jul 29 05:23:54.759176 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 159/352] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:23:54 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:23:54.875551 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-a3773573-57de-440c-85e2-bdb710ad3842 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:54.876272 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-a3773573-57de-440c-85e2-bdb710ad3842 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:54.883984 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a3773573-57de-440c-85e2-bdb710ad3842 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:54.884453 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a3773573-57de-440c-85e2-bdb710ad3842 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:54.885447 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a3773573-57de-440c-85e2-bdb710ad3842 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:54.886130 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a3773573-57de-440c-85e2-bdb710ad3842 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:55.056564 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-5ca60d6b-3bb5-45ea-b2bc-161a48069e47 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:55.057572 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-5ca60d6b-3bb5-45ea-b2bc-161a48069e47 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:55.078065 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5ca60d6b-3bb5-45ea-b2bc-161a48069e47 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:55.078873 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5ca60d6b-3bb5-45ea-b2bc-161a48069e47 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:55.079826 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5ca60d6b-3bb5-45ea-b2bc-161a48069e47 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:55.080289 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5ca60d6b-3bb5-45ea-b2bc-161a48069e47 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:55.108577 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-a3773573-57de-440c-85e2-bdb710ad3842 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:55.119073 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-a3773573-57de-440c-85e2-bdb710ad3842 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1372 microversion: 2.1 time: 0.249541 Jul 29 05:23:55.121738 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 194/353] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:54 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1372 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:55.357824 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-6fc849bf-c798-46cb-97a0-fa1bbc4a3068 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:55.359965 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-6fc849bf-c798-46cb-97a0-fa1bbc4a3068 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:55.374237 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6fc849bf-c798-46cb-97a0-fa1bbc4a3068 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:55.385828 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-5ca60d6b-3bb5-45ea-b2bc-161a48069e47 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:55.392600 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6fc849bf-c798-46cb-97a0-fa1bbc4a3068 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:55.399642 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6fc849bf-c798-46cb-97a0-fa1bbc4a3068 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:55.399642 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6fc849bf-c798-46cb-97a0-fa1bbc4a3068 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:55.416105 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-5ca60d6b-3bb5-45ea-b2bc-161a48069e47 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1723 microversion: 2.1 time: 0.363957 Jul 29 05:23:55.423396 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 160/354] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:55 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1723 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:55.596174 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-6fc849bf-c798-46cb-97a0-fa1bbc4a3068 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:55.621990 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-6fc849bf-c798-46cb-97a0-fa1bbc4a3068 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20" status: 200 len: 1319 microversion: 2.1 time: 0.285603 Jul 29 05:23:55.633005 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 195/355] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:55 2022] GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20 => generated 1319 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:55.788705 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-9f2378c7-f513-484a-a87e-c76374861ae2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:55.789434 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-9f2378c7-f513-484a-a87e-c76374861ae2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:55.798852 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9f2378c7-f513-484a-a87e-c76374861ae2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:55.799126 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9f2378c7-f513-484a-a87e-c76374861ae2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:55.800074 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9f2378c7-f513-484a-a87e-c76374861ae2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:55.800563 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9f2378c7-f513-484a-a87e-c76374861ae2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:56.014374 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-9f2378c7-f513-484a-a87e-c76374861ae2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:56.036152 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-9f2378c7-f513-484a-a87e-c76374861ae2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:56.040039 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-9f2378c7-f513-484a-a87e-c76374861ae2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:56.044014 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-9f2378c7-f513-484a-a87e-c76374861ae2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1722 microversion: 2.20 time: 0.258811 Jul 29 05:23:56.045605 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 161/356] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:23:55 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:23:56.143097 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-053d5624-adb0-49f3-8d91-96042e7149b5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:56.143958 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-053d5624-adb0-49f3-8d91-96042e7149b5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:56.152555 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-053d5624-adb0-49f3-8d91-96042e7149b5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:56.152996 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-053d5624-adb0-49f3-8d91-96042e7149b5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:56.153795 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-053d5624-adb0-49f3-8d91-96042e7149b5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:56.154236 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-053d5624-adb0-49f3-8d91-96042e7149b5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:56.391195 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-053d5624-adb0-49f3-8d91-96042e7149b5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:56.400358 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-053d5624-adb0-49f3-8d91-96042e7149b5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1567 microversion: 2.1 time: 0.261414 Jul 29 05:23:56.402673 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 196/357] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:56 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1567 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:56.435207 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-0802c5f1-092f-4601-832d-7ca9d636ddc7 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:56.437744 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-0802c5f1-092f-4601-832d-7ca9d636ddc7 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:56.446761 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-0c059466-d44f-4ca8-970d-10b728da204d tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:56.449963 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0802c5f1-092f-4601-832d-7ca9d636ddc7 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:56.450864 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0802c5f1-092f-4601-832d-7ca9d636ddc7 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:56.451012 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-0c059466-d44f-4ca8-970d-10b728da204d tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:56.452194 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0802c5f1-092f-4601-832d-7ca9d636ddc7 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:56.453101 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0802c5f1-092f-4601-832d-7ca9d636ddc7 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:56.470429 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0c059466-d44f-4ca8-970d-10b728da204d tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:56.471410 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0c059466-d44f-4ca8-970d-10b728da204d tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:56.472741 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0c059466-d44f-4ca8-970d-10b728da204d tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:56.473719 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0c059466-d44f-4ca8-970d-10b728da204d tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:56.629771 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-0802c5f1-092f-4601-832d-7ca9d636ddc7 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.201514 Jul 29 05:23:56.630652 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 162/358] 10.222.0.49 () {58 vars in 1275 bytes} [Fri Jul 29 05:23:56 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171/os-interface => generated 285 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:23:56.658346 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-8614cf9d-c24f-44be-af8a-36e096bfc42e tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:56.659223 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-8614cf9d-c24f-44be-af8a-36e096bfc42e tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:56.669636 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8614cf9d-c24f-44be-af8a-36e096bfc42e tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:56.670614 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8614cf9d-c24f-44be-af8a-36e096bfc42e tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:56.671908 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8614cf9d-c24f-44be-af8a-36e096bfc42e tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:56.672853 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8614cf9d-c24f-44be-af8a-36e096bfc42e tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:56.750933 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-0c059466-d44f-4ca8-970d-10b728da204d tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:56.765316 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-0c059466-d44f-4ca8-970d-10b728da204d tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1723 microversion: 2.1 time: 0.327140 Jul 29 05:23:56.771706 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 197/359] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:56 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1723 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:57.030081 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-8614cf9d-c24f-44be-af8a-36e096bfc42e tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:57.045903 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-8614cf9d-c24f-44be-af8a-36e096bfc42e tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20" status: 200 len: 1319 microversion: 2.1 time: 0.392935 Jul 29 05:23:57.047518 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 163/360] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:56 2022] GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20 => generated 1319 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:23:57.074521 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-5403605f-c264-4516-ad38-e602e6e932f5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:57.075629 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-5403605f-c264-4516-ad38-e602e6e932f5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:57.082245 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5403605f-c264-4516-ad38-e602e6e932f5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:57.083091 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5403605f-c264-4516-ad38-e602e6e932f5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:57.084182 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5403605f-c264-4516-ad38-e602e6e932f5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:57.084870 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5403605f-c264-4516-ad38-e602e6e932f5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:57.299511 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-5403605f-c264-4516-ad38-e602e6e932f5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:57.314902 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-5403605f-c264-4516-ad38-e602e6e932f5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:57.319079 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-5403605f-c264-4516-ad38-e602e6e932f5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:57.320491 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-5403605f-c264-4516-ad38-e602e6e932f5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1722 microversion: 2.20 time: 0.250173 Jul 29 05:23:57.321904 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 198/361] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:23:57 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:23:57.805527 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-73a058b3-c7ce-4bf6-90f9-ce5cb6aee321 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:57.809064 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-73a058b3-c7ce-4bf6-90f9-ce5cb6aee321 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:57.819979 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-73a058b3-c7ce-4bf6-90f9-ce5cb6aee321 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:57.821237 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-73a058b3-c7ce-4bf6-90f9-ce5cb6aee321 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:57.822754 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-73a058b3-c7ce-4bf6-90f9-ce5cb6aee321 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:57.824040 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-73a058b3-c7ce-4bf6-90f9-ce5cb6aee321 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:58.074004 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-a4ac5d97-34ac-4eef-ac05-7f4cc063698d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:58.075864 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-a4ac5d97-34ac-4eef-ac05-7f4cc063698d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:58.085540 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a4ac5d97-34ac-4eef-ac05-7f4cc063698d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:58.086265 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a4ac5d97-34ac-4eef-ac05-7f4cc063698d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:58.087558 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a4ac5d97-34ac-4eef-ac05-7f4cc063698d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:58.088634 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a4ac5d97-34ac-4eef-ac05-7f4cc063698d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:58.157148 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-73a058b3-c7ce-4bf6-90f9-ce5cb6aee321 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:58.180359 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-73a058b3-c7ce-4bf6-90f9-ce5cb6aee321 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1723 microversion: 2.1 time: 0.383254 Jul 29 05:23:58.183056 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 164/362] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:57 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1723 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:58.303759 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-a4ac5d97-34ac-4eef-ac05-7f4cc063698d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:58.312912 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-a4ac5d97-34ac-4eef-ac05-7f4cc063698d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20" status: 200 len: 1507 microversion: 2.1 time: 0.245345 Jul 29 05:23:58.313734 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 199/363] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:58 2022] GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20 => generated 1507 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:58.356069 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-5340cb17-8f11-4a41-bfd5-846cb0a77fae tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:58.357319 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-5340cb17-8f11-4a41-bfd5-846cb0a77fae tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:58.373772 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5340cb17-8f11-4a41-bfd5-846cb0a77fae tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:58.374611 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5340cb17-8f11-4a41-bfd5-846cb0a77fae tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:58.376150 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5340cb17-8f11-4a41-bfd5-846cb0a77fae tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:58.377054 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5340cb17-8f11-4a41-bfd5-846cb0a77fae tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:58.430268 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-1b8b79c2-3217-428d-8d0e-3eddd9922859 req-1b866dcc-2acd-4052-8305-f12dfb8aab26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00171c99-cf39-4ed6-b78a-3bb24272b171", "tag": "b9da91d9-425e-4a0a-af65-aa645da630ad"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:23:58.464925 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-1b8b79c2-3217-428d-8d0e-3eddd9922859 req-1b866dcc-2acd-4052-8305-f12dfb8aab26 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:58.468208 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-1b8b79c2-3217-428d-8d0e-3eddd9922859 req-1b866dcc-2acd-4052-8305-f12dfb8aab26 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:58.508297 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-1b8b79c2-3217-428d-8d0e-3eddd9922859 req-1b866dcc-2acd-4052-8305-f12dfb8aab26 service nova] Creating event network-changed:b9da91d9-425e-4a0a-af65-aa645da630ad for instance 00171c99-cf39-4ed6-b78a-3bb24272b171 on hv-cinder-85127 Jul 29 05:23:58.522660 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-1b8b79c2-3217-428d-8d0e-3eddd9922859 req-1b866dcc-2acd-4052-8305-f12dfb8aab26 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098087 Jul 29 05:23:58.523657 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 200/364] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:23:58.725964 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-5340cb17-8f11-4a41-bfd5-846cb0a77fae tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:58.729448 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell1:SELECT=100 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:23:58.738570 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-5340cb17-8f11-4a41-bfd5-846cb0a77fae tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:58.740303 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-5340cb17-8f11-4a41-bfd5-846cb0a77fae tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:58.741987 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-5340cb17-8f11-4a41-bfd5-846cb0a77fae tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1722 microversion: 2.20 time: 0.396770 Jul 29 05:23:58.743146 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 165/365] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:23:58 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1722 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:23:59.230684 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-5c319808-5821-4e6d-a46d-6a8ba003adbc tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:59.232459 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-5c319808-5821-4e6d-a46d-6a8ba003adbc tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:59.245847 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5c319808-5821-4e6d-a46d-6a8ba003adbc tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:59.246923 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5c319808-5821-4e6d-a46d-6a8ba003adbc tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:59.248694 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5c319808-5821-4e6d-a46d-6a8ba003adbc tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:59.249621 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5c319808-5821-4e6d-a46d-6a8ba003adbc tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:59.653893 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-5c319808-5821-4e6d-a46d-6a8ba003adbc tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:23:59.687762 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-5c319808-5821-4e6d-a46d-6a8ba003adbc tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1723 microversion: 2.1 time: 0.476488 Jul 29 05:23:59.689075 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 201/366] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:23:59 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1723 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:23:59.789264 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-a73de002-0a76-499f-817a-f06d51feb26e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:23:59.790394 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-a73de002-0a76-499f-817a-f06d51feb26e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:23:59.813150 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a73de002-0a76-499f-817a-f06d51feb26e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:59.814526 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a73de002-0a76-499f-817a-f06d51feb26e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:23:59.815873 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a73de002-0a76-499f-817a-f06d51feb26e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:23:59.817715 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a73de002-0a76-499f-817a-f06d51feb26e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:00.291105 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-a73de002-0a76-499f-817a-f06d51feb26e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:00.317418 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-a73de002-0a76-499f-817a-f06d51feb26e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:00.326034 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-a73de002-0a76-499f-817a-f06d51feb26e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:00.331256 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-a73de002-0a76-499f-817a-f06d51feb26e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1743 microversion: 2.20 time: 0.550211 Jul 29 05:24:00.332737 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 166/367] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:23:59 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1743 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:24:00.725360 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-1de769ca-0698-4004-a493-3869815505fb tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:00.731377 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-1de769ca-0698-4004-a493-3869815505fb tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:00.751927 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1de769ca-0698-4004-a493-3869815505fb tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:00.753814 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1de769ca-0698-4004-a493-3869815505fb tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:00.756649 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1de769ca-0698-4004-a493-3869815505fb tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:00.757901 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1de769ca-0698-4004-a493-3869815505fb tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:00.985237 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-1de769ca-0698-4004-a493-3869815505fb tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:01.010664 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-1de769ca-0698-4004-a493-3869815505fb tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1723 microversion: 2.1 time: 0.293071 Jul 29 05:24:01.012820 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 202/368] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:00 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1723 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:01.361628 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-e4070e85-1cfa-46f4-a377-c05345c577d1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:01.362326 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-e4070e85-1cfa-46f4-a377-c05345c577d1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:01.371202 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e4070e85-1cfa-46f4-a377-c05345c577d1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:01.371706 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e4070e85-1cfa-46f4-a377-c05345c577d1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:01.372571 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e4070e85-1cfa-46f4-a377-c05345c577d1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:01.373220 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e4070e85-1cfa-46f4-a377-c05345c577d1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:01.575401 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-e4070e85-1cfa-46f4-a377-c05345c577d1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:01.590452 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-e4070e85-1cfa-46f4-a377-c05345c577d1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:01.594346 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-e4070e85-1cfa-46f4-a377-c05345c577d1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:01.596757 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-e4070e85-1cfa-46f4-a377-c05345c577d1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1738 microversion: 2.20 time: 0.239962 Jul 29 05:24:01.598091 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 167/369] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:01 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1738 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:24:02.048630 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-fb1a034e-7a7e-4932-8dfc-13e8cdbfc409 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:02.049494 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-fb1a034e-7a7e-4932-8dfc-13e8cdbfc409 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:02.058145 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-fb1a034e-7a7e-4932-8dfc-13e8cdbfc409 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:02.058985 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-fb1a034e-7a7e-4932-8dfc-13e8cdbfc409 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:02.060042 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-fb1a034e-7a7e-4932-8dfc-13e8cdbfc409 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:02.060884 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-fb1a034e-7a7e-4932-8dfc-13e8cdbfc409 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:02.219240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-fbd6ba78-fb0e-42e5-b612-4feecf5f9b45 req-71e16275-63b8-404f-82fe-4715b4cf8503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ff4221e-eadc-491b-9f3c-9b41413a63d0", "name": "network-vif-plugged", "status": "completed", "tag": "de35419f-6c42-424f-baf0-e88731e69e60"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:24:02.238350 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-fbd6ba78-fb0e-42e5-b612-4feecf5f9b45 req-71e16275-63b8-404f-82fe-4715b4cf8503 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:02.239335 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-fbd6ba78-fb0e-42e5-b612-4feecf5f9b45 req-71e16275-63b8-404f-82fe-4715b4cf8503 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:02.256282 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-fbd6ba78-fb0e-42e5-b612-4feecf5f9b45 req-71e16275-63b8-404f-82fe-4715b4cf8503 service nova] Creating event network-vif-plugged:de35419f-6c42-424f-baf0-e88731e69e60 for instance 6ff4221e-eadc-491b-9f3c-9b41413a63d0 on hv-cinder-85127 Jul 29 05:24:02.262861 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-fbd6ba78-fb0e-42e5-b612-4feecf5f9b45 req-71e16275-63b8-404f-82fe-4715b4cf8503 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049445 Jul 29 05:24:02.264059 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 168/370] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:24:02.356610 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-fb1a034e-7a7e-4932-8dfc-13e8cdbfc409 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:02.367074 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-fb1a034e-7a7e-4932-8dfc-13e8cdbfc409 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1723 microversion: 2.1 time: 0.322385 Jul 29 05:24:02.374631 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 203/371] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:02 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1723 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:02.648319 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-64d5a313-57d7-4f98-9b42-548225f042b6 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:02.652566 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-64d5a313-57d7-4f98-9b42-548225f042b6 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:02.663033 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-64d5a313-57d7-4f98-9b42-548225f042b6 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:02.664213 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-64d5a313-57d7-4f98-9b42-548225f042b6 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:02.665811 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-64d5a313-57d7-4f98-9b42-548225f042b6 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:02.668842 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-64d5a313-57d7-4f98-9b42-548225f042b6 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:02.906504 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-64d5a313-57d7-4f98-9b42-548225f042b6 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:02.926950 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-64d5a313-57d7-4f98-9b42-548225f042b6 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:02.929100 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-64d5a313-57d7-4f98-9b42-548225f042b6 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:02.930666 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-64d5a313-57d7-4f98-9b42-548225f042b6 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1738 microversion: 2.20 time: 0.292739 Jul 29 05:24:02.933004 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 169/372] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:02 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1738 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:24:03.404882 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-2752ad12-e8cb-4b85-9dd0-36a3bb5afcb6 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:03.406544 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-2752ad12-e8cb-4b85-9dd0-36a3bb5afcb6 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:03.421256 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2752ad12-e8cb-4b85-9dd0-36a3bb5afcb6 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:03.432696 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2752ad12-e8cb-4b85-9dd0-36a3bb5afcb6 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:03.435182 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2752ad12-e8cb-4b85-9dd0-36a3bb5afcb6 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:03.435870 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2752ad12-e8cb-4b85-9dd0-36a3bb5afcb6 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:03.685639 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-2752ad12-e8cb-4b85-9dd0-36a3bb5afcb6 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:03.703296 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell1:SELECT=100 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:24:03.712187 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-2752ad12-e8cb-4b85-9dd0-36a3bb5afcb6 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1700 microversion: 2.1 time: 0.311410 Jul 29 05:24:03.714949 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 204/373] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:03 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1700 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:03.741274 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-f86f98b4-13e1-4b02-afcb-a42e57c1bd60 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:24:03.774477 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f86f98b4-13e1-4b02-afcb-a42e57c1bd60 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:03.776265 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f86f98b4-13e1-4b02-afcb-a42e57c1bd60 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:03.893752 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-f86f98b4-13e1-4b02-afcb-a42e57c1bd60 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Going to try to start instance {{(pid=117820) start /opt/stack/nova/nova/compute/api.py:2732}} Jul 29 05:24:03.966798 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-29c51f80-3cdc-4f2a-9e2d-7c59094ef659 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:03.967538 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-29c51f80-3cdc-4f2a-9e2d-7c59094ef659 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:03.980117 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-f86f98b4-13e1-4b02-afcb-a42e57c1bd60 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "POST /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba/action" status: 202 len: 0 microversion: 2.1 time: 0.245549 Jul 29 05:24:03.983514 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 170/374] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Jul 29 05:24:03 2022] POST /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 05:24:03.989801 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-29c51f80-3cdc-4f2a-9e2d-7c59094ef659 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:03.990600 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-29c51f80-3cdc-4f2a-9e2d-7c59094ef659 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:03.992074 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-29c51f80-3cdc-4f2a-9e2d-7c59094ef659 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:03.995113 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-29c51f80-3cdc-4f2a-9e2d-7c59094ef659 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:03.995531 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-e61bb9cd-0254-4188-9d31-3d829c42b9e0 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:03.996463 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-e61bb9cd-0254-4188-9d31-3d829c42b9e0 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:04.004395 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e61bb9cd-0254-4188-9d31-3d829c42b9e0 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:04.005627 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e61bb9cd-0254-4188-9d31-3d829c42b9e0 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:04.007168 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e61bb9cd-0254-4188-9d31-3d829c42b9e0 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:04.008144 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e61bb9cd-0254-4188-9d31-3d829c42b9e0 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:04.315436 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-e61bb9cd-0254-4188-9d31-3d829c42b9e0 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:04.331078 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-e61bb9cd-0254-4188-9d31-3d829c42b9e0 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1709 microversion: 2.1 time: 0.341883 Jul 29 05:24:04.336219 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 171/375] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:03 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1709 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:04.470247 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-29c51f80-3cdc-4f2a-9e2d-7c59094ef659 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:04.494584 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-29c51f80-3cdc-4f2a-9e2d-7c59094ef659 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:04.498665 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-29c51f80-3cdc-4f2a-9e2d-7c59094ef659 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:04.505667 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-29c51f80-3cdc-4f2a-9e2d-7c59094ef659 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1738 microversion: 2.20 time: 0.549167 Jul 29 05:24:04.506861 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 205/376] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:03 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1738 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:24:05.390278 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-44d3d257-8df2-4f23-acf8-599619e2960b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:05.395651 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-44d3d257-8df2-4f23-acf8-599619e2960b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:05.422167 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-44d3d257-8df2-4f23-acf8-599619e2960b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:05.423520 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-44d3d257-8df2-4f23-acf8-599619e2960b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:05.425408 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-44d3d257-8df2-4f23-acf8-599619e2960b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:05.426447 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-44d3d257-8df2-4f23-acf8-599619e2960b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:05.543837 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-bf24bfcd-e177-4b2e-994b-ce30a9b8e2fe tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:05.545420 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-bf24bfcd-e177-4b2e-994b-ce30a9b8e2fe tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:05.561085 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bf24bfcd-e177-4b2e-994b-ce30a9b8e2fe tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:05.561970 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bf24bfcd-e177-4b2e-994b-ce30a9b8e2fe tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:05.564883 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bf24bfcd-e177-4b2e-994b-ce30a9b8e2fe tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:05.565572 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bf24bfcd-e177-4b2e-994b-ce30a9b8e2fe tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:05.706003 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-44d3d257-8df2-4f23-acf8-599619e2960b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:05.716908 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-44d3d257-8df2-4f23-acf8-599619e2960b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1709 microversion: 2.1 time: 0.339895 Jul 29 05:24:05.717516 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 172/377] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:05 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1709 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:05.867657 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-bf24bfcd-e177-4b2e-994b-ce30a9b8e2fe tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:05.879658 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-bf24bfcd-e177-4b2e-994b-ce30a9b8e2fe tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:05.883810 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-bf24bfcd-e177-4b2e-994b-ce30a9b8e2fe tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:05.885374 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-bf24bfcd-e177-4b2e-994b-ce30a9b8e2fe tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1738 microversion: 2.20 time: 0.346961 Jul 29 05:24:05.886520 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 206/378] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:05 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1738 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:24:06.774219 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-29eff2b3-f6ae-425a-8497-77f13a7a59cf tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:06.778797 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-29eff2b3-f6ae-425a-8497-77f13a7a59cf tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:06.816972 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-29eff2b3-f6ae-425a-8497-77f13a7a59cf tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:06.817831 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-29eff2b3-f6ae-425a-8497-77f13a7a59cf tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:06.820543 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-29eff2b3-f6ae-425a-8497-77f13a7a59cf tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:06.820941 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-29eff2b3-f6ae-425a-8497-77f13a7a59cf tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:06.917241 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-79b7a2f0-557c-432c-b4a9-792b1249740e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:06.918110 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-79b7a2f0-557c-432c-b4a9-792b1249740e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:06.945285 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-79b7a2f0-557c-432c-b4a9-792b1249740e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:06.945737 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-79b7a2f0-557c-432c-b4a9-792b1249740e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:06.954535 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-79b7a2f0-557c-432c-b4a9-792b1249740e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:06.958649 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-79b7a2f0-557c-432c-b4a9-792b1249740e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:07.136379 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-29eff2b3-f6ae-425a-8497-77f13a7a59cf tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:07.160463 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-29eff2b3-f6ae-425a-8497-77f13a7a59cf tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1713 microversion: 2.1 time: 0.418851 Jul 29 05:24:07.175378 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 173/379] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:06 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1713 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:07.326413 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-79b7a2f0-557c-432c-b4a9-792b1249740e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:07.344664 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-79b7a2f0-557c-432c-b4a9-792b1249740e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:07.346245 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-79b7a2f0-557c-432c-b4a9-792b1249740e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:07.347920 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-79b7a2f0-557c-432c-b4a9-792b1249740e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1738 microversion: 2.20 time: 0.442871 Jul 29 05:24:07.348537 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 207/380] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:06 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1738 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:24:08.387764 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-dc9e89a5-d61d-4576-b77c-06927d85394b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:08.388656 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-dc9e89a5-d61d-4576-b77c-06927d85394b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:08.398795 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-dc9e89a5-d61d-4576-b77c-06927d85394b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:08.399826 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-dc9e89a5-d61d-4576-b77c-06927d85394b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:08.401446 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-dc9e89a5-d61d-4576-b77c-06927d85394b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:08.402108 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-dc9e89a5-d61d-4576-b77c-06927d85394b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:08.622354 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-dc9e89a5-d61d-4576-b77c-06927d85394b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:08.633087 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-dc9e89a5-d61d-4576-b77c-06927d85394b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:08.636279 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-dc9e89a5-d61d-4576-b77c-06927d85394b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:08.637887 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-dc9e89a5-d61d-4576-b77c-06927d85394b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1738 microversion: 2.20 time: 0.265136 Jul 29 05:24:08.640008 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 174/381] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:08 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1738 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:24:08.757624 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-6b82e3e2-bcbe-4df3-ba0c-fa30bacb29e7 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1438560349", "imageRef": "b7bf870d-4e7c-42fd-849f-72ac19277493", "flavorRef": "452", "networks": [{"uuid": "6d50987d-b297-4c09-b50b-2b3a4e60a74e"}]}} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:24:09.667149 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-46ed5a63-5574-4ed7-adc8-940a92a20122 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:09.667978 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-46ed5a63-5574-4ed7-adc8-940a92a20122 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:09.672435 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_api:SELECT=86 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:24:09.683135 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-46ed5a63-5574-4ed7-adc8-940a92a20122 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:09.683626 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-46ed5a63-5574-4ed7-adc8-940a92a20122 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:09.684621 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-46ed5a63-5574-4ed7-adc8-940a92a20122 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:09.685749 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-46ed5a63-5574-4ed7-adc8-940a92a20122 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:09.919683 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-46ed5a63-5574-4ed7-adc8-940a92a20122 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:09.929603 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-46ed5a63-5574-4ed7-adc8-940a92a20122 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:09.932033 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-46ed5a63-5574-4ed7-adc8-940a92a20122 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:09.933692 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-46ed5a63-5574-4ed7-adc8-940a92a20122 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1738 microversion: 2.20 time: 0.274039 Jul 29 05:24:09.948369 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 175/382] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:09 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1738 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:24:10.961466 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-7b530a1c-6eae-4495-9603-926b97e5828c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:10.962146 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-7b530a1c-6eae-4495-9603-926b97e5828c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:10.972222 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7b530a1c-6eae-4495-9603-926b97e5828c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:10.972719 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7b530a1c-6eae-4495-9603-926b97e5828c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:10.973682 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7b530a1c-6eae-4495-9603-926b97e5828c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:10.974330 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7b530a1c-6eae-4495-9603-926b97e5828c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:11.206051 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-7b530a1c-6eae-4495-9603-926b97e5828c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:11.215912 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-7b530a1c-6eae-4495-9603-926b97e5828c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:11.217895 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-7b530a1c-6eae-4495-9603-926b97e5828c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:11.219243 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-7b530a1c-6eae-4495-9603-926b97e5828c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1738 microversion: 2.20 time: 0.261690 Jul 29 05:24:11.219954 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 176/383] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:10 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1738 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:24:11.792030 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.network.neutron [None req-6b82e3e2-bcbe-4df3-ba0c-fa30bacb29e7 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] validate_networks() for [('6d50987d-b297-4c09-b50b-2b3a4e60a74e', None, None, None, None, None)] {{(pid=117821) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 05:24:12.258298 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-3ab4aea0-5f9d-4a37-9873-56921f8c6f2e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:12.258893 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-3ab4aea0-5f9d-4a37-9873-56921f8c6f2e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:12.270887 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3ab4aea0-5f9d-4a37-9873-56921f8c6f2e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:12.271333 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3ab4aea0-5f9d-4a37-9873-56921f8c6f2e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:12.272913 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3ab4aea0-5f9d-4a37-9873-56921f8c6f2e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:12.274062 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3ab4aea0-5f9d-4a37-9873-56921f8c6f2e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:12.500837 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-6b82e3e2-bcbe-4df3-ba0c-fa30bacb29e7 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Flavor limits 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 05:24:12.502434 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-6b82e3e2-bcbe-4df3-ba0c-fa30bacb29e7 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Image limits 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 05:24:12.503286 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-6b82e3e2-bcbe-4df3-ba0c-fa30bacb29e7 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Flavor pref 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 05:24:12.503945 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-6b82e3e2-bcbe-4df3-ba0c-fa30bacb29e7 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Image pref 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 05:24:12.504597 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-6b82e3e2-bcbe-4df3-ba0c-fa30bacb29e7 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 05:24:12.515658 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6b82e3e2-bcbe-4df3-ba0c-fa30bacb29e7 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:12.516516 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6b82e3e2-bcbe-4df3-ba0c-fa30bacb29e7 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:12.517570 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6b82e3e2-bcbe-4df3-ba0c-fa30bacb29e7 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:12.518220 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6b82e3e2-bcbe-4df3-ba0c-fa30bacb29e7 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:12.538962 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.quota [None req-6b82e3e2-bcbe-4df3-ba0c-fa30bacb29e7 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Getting quotas for project b28baf3f14f74766b11c9ee459b8d5ec. Resources: {'instances', 'ram', 'cores'} {{(pid=117821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:24:12.544915 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.quota [None req-6b82e3e2-bcbe-4df3-ba0c-fa30bacb29e7 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Getting quotas for user 27709d338705483b97997fcfd48d1d4a and project b28baf3f14f74766b11c9ee459b8d5ec. Resources: {'instances', 'ram', 'cores'} {{(pid=117821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:24:12.563575 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-3ab4aea0-5f9d-4a37-9873-56921f8c6f2e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:12.575332 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-6b82e3e2-bcbe-4df3-ba0c-fa30bacb29e7 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Going to run 1 instances... {{(pid=117821) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 05:24:12.578906 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-6b82e3e2-bcbe-4df3-ba0c-fa30bacb29e7 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: 97bc6de7-a7b6-4f34-81f8-a1866a7eac99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b7bf870d-4e7c-42fd-849f-72ac19277493',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117821) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 05:24:12.580069 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-3ab4aea0-5f9d-4a37-9873-56921f8c6f2e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:12.583515 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-3ab4aea0-5f9d-4a37-9873-56921f8c6f2e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:12.586163 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-3ab4aea0-5f9d-4a37-9873-56921f8c6f2e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1738 microversion: 2.20 time: 0.332515 Jul 29 05:24:12.587571 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 177/384] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:12 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1738 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:24:12.667944 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-6b82e3e2-bcbe-4df3-ba0c-fa30bacb29e7 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.918135 Jul 29 05:24:12.676999 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 208/385] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 05:24:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 3928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 05:24:12.683581 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-9c407c71-974d-4767-99d6-7c549f1e0272 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:12.684670 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-9c407c71-974d-4767-99d6-7c549f1e0272 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: 97bc6de7-a7b6-4f34-81f8-a1866a7eac99] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:12.796637 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-9c407c71-974d-4767-99d6-7c549f1e0272 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:12.808655 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-9c407c71-974d-4767-99d6-7c549f1e0272 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99" status: 200 len: 1214 microversion: 2.1 time: 0.130543 Jul 29 05:24:12.809997 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 178/386] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:12 2022] GET /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99 => generated 1214 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:13.614905 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-75e5cee5-634f-44e3-91f0-b738e818e6d0 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:13.616128 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-75e5cee5-634f-44e3-91f0-b738e818e6d0 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:13.624397 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-75e5cee5-634f-44e3-91f0-b738e818e6d0 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:13.625113 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-75e5cee5-634f-44e3-91f0-b738e818e6d0 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:13.625911 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-75e5cee5-634f-44e3-91f0-b738e818e6d0 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:13.626411 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-75e5cee5-634f-44e3-91f0-b738e818e6d0 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:13.814326 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-75e5cee5-634f-44e3-91f0-b738e818e6d0 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:13.830818 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-75e5cee5-634f-44e3-91f0-b738e818e6d0 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:13.831149 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-5c31aaf2-2139-45ea-a82d-141295445d05 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:13.831681 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-5c31aaf2-2139-45ea-a82d-141295445d05 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: 97bc6de7-a7b6-4f34-81f8-a1866a7eac99] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:13.836577 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-75e5cee5-634f-44e3-91f0-b738e818e6d0 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:13.838957 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-75e5cee5-634f-44e3-91f0-b738e818e6d0 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1738 microversion: 2.20 time: 0.228646 Jul 29 05:24:13.841856 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5c31aaf2-2139-45ea-a82d-141295445d05 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:13.842584 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5c31aaf2-2139-45ea-a82d-141295445d05 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:13.843830 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5c31aaf2-2139-45ea-a82d-141295445d05 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:13.844357 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 209/387] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:13 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1738 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:24:13.844885 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5c31aaf2-2139-45ea-a82d-141295445d05 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:13.923253 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-5c31aaf2-2139-45ea-a82d-141295445d05 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:13.934266 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-5c31aaf2-2139-45ea-a82d-141295445d05 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99" status: 200 len: 1266 microversion: 2.1 time: 0.107673 Jul 29 05:24:13.936099 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 179/388] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:13 2022] GET /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99 => generated 1266 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:24:14.867970 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-d0773768-acc9-4bec-b34c-db797bc43faa tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:14.868653 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-d0773768-acc9-4bec-b34c-db797bc43faa tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:14.877141 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d0773768-acc9-4bec-b34c-db797bc43faa tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:14.877794 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d0773768-acc9-4bec-b34c-db797bc43faa tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:14.878878 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d0773768-acc9-4bec-b34c-db797bc43faa tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:14.879582 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d0773768-acc9-4bec-b34c-db797bc43faa tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:14.960018 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-0cde55c1-ed73-4504-ba6e-a3526a9a2140 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:14.961358 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-0cde55c1-ed73-4504-ba6e-a3526a9a2140 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: 97bc6de7-a7b6-4f34-81f8-a1866a7eac99] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:14.968706 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0cde55c1-ed73-4504-ba6e-a3526a9a2140 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:14.969151 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0cde55c1-ed73-4504-ba6e-a3526a9a2140 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:14.970175 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0cde55c1-ed73-4504-ba6e-a3526a9a2140 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:14.970620 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0cde55c1-ed73-4504-ba6e-a3526a9a2140 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:15.076959 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-d0773768-acc9-4bec-b34c-db797bc43faa tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:15.086399 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-d0773768-acc9-4bec-b34c-db797bc43faa tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:15.088151 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-d0773768-acc9-4bec-b34c-db797bc43faa tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:15.089506 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-d0773768-acc9-4bec-b34c-db797bc43faa tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1720 microversion: 2.20 time: 0.225604 Jul 29 05:24:15.090177 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 210/389] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:14 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1720 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:24:15.461120 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-0cde55c1-ed73-4504-ba6e-a3526a9a2140 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:15.470016 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-0cde55c1-ed73-4504-ba6e-a3526a9a2140 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99" status: 200 len: 1314 microversion: 2.1 time: 0.516031 Jul 29 05:24:15.470635 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 180/390] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:14 2022] GET /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99 => generated 1314 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:16.117244 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-e578b7ed-8a0a-4c00-bc3b-fd401425f787 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:16.118068 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-e578b7ed-8a0a-4c00-bc3b-fd401425f787 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:16.128443 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e578b7ed-8a0a-4c00-bc3b-fd401425f787 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:16.128912 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e578b7ed-8a0a-4c00-bc3b-fd401425f787 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:16.130143 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e578b7ed-8a0a-4c00-bc3b-fd401425f787 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:16.130814 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e578b7ed-8a0a-4c00-bc3b-fd401425f787 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:16.318106 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-e578b7ed-8a0a-4c00-bc3b-fd401425f787 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:16.328538 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-e578b7ed-8a0a-4c00-bc3b-fd401425f787 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:16.330224 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-e578b7ed-8a0a-4c00-bc3b-fd401425f787 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:16.331655 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-e578b7ed-8a0a-4c00-bc3b-fd401425f787 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1720 microversion: 2.20 time: 0.221174 Jul 29 05:24:16.332340 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 211/391] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:16 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1720 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:24:16.506378 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-1fc9a692-fd63-40d6-bc82-cf2ae8c57488 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:16.507804 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-1fc9a692-fd63-40d6-bc82-cf2ae8c57488 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: 97bc6de7-a7b6-4f34-81f8-a1866a7eac99] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:16.515731 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1fc9a692-fd63-40d6-bc82-cf2ae8c57488 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:16.516180 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1fc9a692-fd63-40d6-bc82-cf2ae8c57488 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:16.516979 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1fc9a692-fd63-40d6-bc82-cf2ae8c57488 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:16.517465 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1fc9a692-fd63-40d6-bc82-cf2ae8c57488 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:16.738665 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-1fc9a692-fd63-40d6-bc82-cf2ae8c57488 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:16.749665 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-1fc9a692-fd63-40d6-bc82-cf2ae8c57488 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99" status: 200 len: 1314 microversion: 2.1 time: 0.247118 Jul 29 05:24:16.750597 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 181/392] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:16 2022] GET /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:24:16.844106 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-6f4e96b8-610f-46ac-8db3-09cd00897ad1 req-8595442f-b77f-4f29-9e44-4c0ed013af13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97bc6de7-a7b6-4f34-81f8-a1866a7eac99", "tag": "8ffd92af-5f7d-4f45-9130-319553ac55db"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:24:16.858234 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-6f4e96b8-610f-46ac-8db3-09cd00897ad1 req-8595442f-b77f-4f29-9e44-4c0ed013af13 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:16.858566 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-6f4e96b8-610f-46ac-8db3-09cd00897ad1 req-8595442f-b77f-4f29-9e44-4c0ed013af13 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:16.872632 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-6f4e96b8-610f-46ac-8db3-09cd00897ad1 req-8595442f-b77f-4f29-9e44-4c0ed013af13 service nova] Creating event network-changed:8ffd92af-5f7d-4f45-9130-319553ac55db for instance 97bc6de7-a7b6-4f34-81f8-a1866a7eac99 on hv-cinder-85127 Jul 29 05:24:16.878345 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-6f4e96b8-610f-46ac-8db3-09cd00897ad1 req-8595442f-b77f-4f29-9e44-4c0ed013af13 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039612 Jul 29 05:24:16.879101 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 212/393] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:24:17.358920 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-8f87f9eb-b947-4f1d-9e15-fd4b45e323a1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:17.359568 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-8f87f9eb-b947-4f1d-9e15-fd4b45e323a1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:17.369300 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8f87f9eb-b947-4f1d-9e15-fd4b45e323a1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:17.369990 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8f87f9eb-b947-4f1d-9e15-fd4b45e323a1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:17.371403 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8f87f9eb-b947-4f1d-9e15-fd4b45e323a1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:17.372520 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8f87f9eb-b947-4f1d-9e15-fd4b45e323a1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:17.537703 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-8f87f9eb-b947-4f1d-9e15-fd4b45e323a1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:17.547450 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-8f87f9eb-b947-4f1d-9e15-fd4b45e323a1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:17.548970 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-8f87f9eb-b947-4f1d-9e15-fd4b45e323a1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:17.550152 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-8f87f9eb-b947-4f1d-9e15-fd4b45e323a1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1720 microversion: 2.20 time: 0.195206 Jul 29 05:24:17.550730 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 182/394] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:17 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1720 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:24:17.773800 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-173b1024-c0b2-4bab-be85-ddd12b37ee4e tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c191f2b9-cbb1-4fec-ad49-d8e6a3b44981", "device": "/dev/sdb"}} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:24:17.775203 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-8af6421b-2cef-476d-9432-5b9c506f5e99 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:17.776424 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-8af6421b-2cef-476d-9432-5b9c506f5e99 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: 97bc6de7-a7b6-4f34-81f8-a1866a7eac99] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:17.778889 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-173b1024-c0b2-4bab-be85-ddd12b37ee4e tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:17.787523 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8af6421b-2cef-476d-9432-5b9c506f5e99 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:17.788247 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8af6421b-2cef-476d-9432-5b9c506f5e99 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:17.788484 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-173b1024-c0b2-4bab-be85-ddd12b37ee4e tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:17.789162 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-173b1024-c0b2-4bab-be85-ddd12b37ee4e tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:17.789590 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8af6421b-2cef-476d-9432-5b9c506f5e99 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:17.790401 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-173b1024-c0b2-4bab-be85-ddd12b37ee4e tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:17.790511 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8af6421b-2cef-476d-9432-5b9c506f5e99 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:17.791062 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-173b1024-c0b2-4bab-be85-ddd12b37ee4e tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:17.799210 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:24:17.973023 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-8af6421b-2cef-476d-9432-5b9c506f5e99 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:17.981475 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-8af6421b-2cef-476d-9432-5b9c506f5e99 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99" status: 200 len: 1314 microversion: 2.1 time: 0.212385 Jul 29 05:24:17.982075 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 183/395] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:17 2022] GET /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:24:18.127481 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-ef3b13b9-4c45-4a1b-8432-d3b3b921621f req-0393e58e-1595-4d11-9c5f-dcb234980df4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ff4221e-eadc-491b-9f3c-9b41413a63d0", "name": "network-vif-unplugged", "status": "completed", "tag": "de35419f-6c42-424f-baf0-e88731e69e60"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:24:18.142555 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-ef3b13b9-4c45-4a1b-8432-d3b3b921621f req-0393e58e-1595-4d11-9c5f-dcb234980df4 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:18.143336 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-ef3b13b9-4c45-4a1b-8432-d3b3b921621f req-0393e58e-1595-4d11-9c5f-dcb234980df4 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:18.166657 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-ef3b13b9-4c45-4a1b-8432-d3b3b921621f req-0393e58e-1595-4d11-9c5f-dcb234980df4 service nova] Creating event network-vif-unplugged:de35419f-6c42-424f-baf0-e88731e69e60 for instance 6ff4221e-eadc-491b-9f3c-9b41413a63d0 on hv-cinder-85127 Jul 29 05:24:18.175953 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-ef3b13b9-4c45-4a1b-8432-d3b3b921621f req-0393e58e-1595-4d11-9c5f-dcb234980df4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051704 Jul 29 05:24:18.176991 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 184/396] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:24:18.576435 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-e62fffde-127b-4b72-92f4-50749ed66e25 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:18.579752 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-e62fffde-127b-4b72-92f4-50749ed66e25 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:18.590608 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e62fffde-127b-4b72-92f4-50749ed66e25 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:18.590898 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e62fffde-127b-4b72-92f4-50749ed66e25 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:18.592075 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e62fffde-127b-4b72-92f4-50749ed66e25 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:18.592585 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e62fffde-127b-4b72-92f4-50749ed66e25 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:18.752114 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-173b1024-c0b2-4bab-be85-ddd12b37ee4e tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "POST /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.982878 Jul 29 05:24:18.757819 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 213/397] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Jul 29 05:24:17 2022] POST /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20/os-volume_attachments => generated 194 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:24:18.937185 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-e62fffde-127b-4b72-92f4-50749ed66e25 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:18.945730 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-e62fffde-127b-4b72-92f4-50749ed66e25 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:18.947909 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-e62fffde-127b-4b72-92f4-50749ed66e25 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:18.949130 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-e62fffde-127b-4b72-92f4-50749ed66e25 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1720 microversion: 2.20 time: 0.379022 Jul 29 05:24:18.949649 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 185/398] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:18 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1720 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:24:19.004635 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-47d0fc15-cb23-4ee4-bd2a-4f690af1a824 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:19.005405 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-47d0fc15-cb23-4ee4-bd2a-4f690af1a824 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: 97bc6de7-a7b6-4f34-81f8-a1866a7eac99] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:19.013513 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-47d0fc15-cb23-4ee4-bd2a-4f690af1a824 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:19.014149 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-47d0fc15-cb23-4ee4-bd2a-4f690af1a824 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:19.015054 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-47d0fc15-cb23-4ee4-bd2a-4f690af1a824 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:19.015647 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-47d0fc15-cb23-4ee4-bd2a-4f690af1a824 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:19.188949 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-47d0fc15-cb23-4ee4-bd2a-4f690af1a824 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:19.199295 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-47d0fc15-cb23-4ee4-bd2a-4f690af1a824 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99" status: 200 len: 1314 microversion: 2.1 time: 0.199556 Jul 29 05:24:19.211477 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 214/399] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:18 2022] GET /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:19.973263 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-4e5cf6d8-caae-4b69-ad01-bf8dd76d0eda tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:19.973872 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-4e5cf6d8-caae-4b69-ad01-bf8dd76d0eda tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:19.981882 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-4e5cf6d8-caae-4b69-ad01-bf8dd76d0eda tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:19.982325 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-4e5cf6d8-caae-4b69-ad01-bf8dd76d0eda tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:19.983102 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-4e5cf6d8-caae-4b69-ad01-bf8dd76d0eda tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:19.983583 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-4e5cf6d8-caae-4b69-ad01-bf8dd76d0eda tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:20.137767 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-4e5cf6d8-caae-4b69-ad01-bf8dd76d0eda tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:20.146513 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-4e5cf6d8-caae-4b69-ad01-bf8dd76d0eda tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:20.148232 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-4e5cf6d8-caae-4b69-ad01-bf8dd76d0eda tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:20.149959 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-4e5cf6d8-caae-4b69-ad01-bf8dd76d0eda tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1663 microversion: 2.20 time: 0.180303 Jul 29 05:24:20.150632 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 186/400] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:19 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1663 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:24:20.192552 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-6d4e6827-7042-4c11-baba-1ff8a2da3685 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ac1d70f-5eb7-4c7a-8de9-d8a9e5abd25c"}} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:24:20.195112 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-6d4e6827-7042-4c11-baba-1ff8a2da3685 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:20.203417 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6d4e6827-7042-4c11-baba-1ff8a2da3685 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:20.203893 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6d4e6827-7042-4c11-baba-1ff8a2da3685 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:20.204800 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6d4e6827-7042-4c11-baba-1ff8a2da3685 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:20.205436 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6d4e6827-7042-4c11-baba-1ff8a2da3685 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:20.239849 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-ceeb611b-e10d-4a7e-a8f3-4a9ebb765201 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:20.240908 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-ceeb611b-e10d-4a7e-a8f3-4a9ebb765201 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: 97bc6de7-a7b6-4f34-81f8-a1866a7eac99] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:20.253367 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ceeb611b-e10d-4a7e-a8f3-4a9ebb765201 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:20.254186 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ceeb611b-e10d-4a7e-a8f3-4a9ebb765201 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:20.255641 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ceeb611b-e10d-4a7e-a8f3-4a9ebb765201 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:20.256451 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ceeb611b-e10d-4a7e-a8f3-4a9ebb765201 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:20.461202 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-ceeb611b-e10d-4a7e-a8f3-4a9ebb765201 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:20.471724 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-ceeb611b-e10d-4a7e-a8f3-4a9ebb765201 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99" status: 200 len: 1314 microversion: 2.1 time: 0.239469 Jul 29 05:24:20.472693 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 187/401] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:20 2022] GET /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:20.581729 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-6d4e6827-7042-4c11-baba-1ff8a2da3685 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "POST /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.393601 Jul 29 05:24:20.582347 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 215/402] 10.222.0.49 () {62 vars in 1364 bytes} [Fri Jul 29 05:24:20 2022] POST /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0/os-volume_attachments => generated 188 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 05:24:20.713743 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-07746d09-cd57-4188-9fc1-e4d091136ffd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:24:20.714445 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-07746d09-cd57-4188-9fc1-e4d091136ffd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:20.721612 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-07746d09-cd57-4188-9fc1-e4d091136ffd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:20.722061 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-07746d09-cd57-4188-9fc1-e4d091136ffd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:20.722844 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-07746d09-cd57-4188-9fc1-e4d091136ffd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:20.723282 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-07746d09-cd57-4188-9fc1-e4d091136ffd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:20.770577 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-07746d09-cd57-4188-9fc1-e4d091136ffd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117820) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 29 05:24:20.849004 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-07746d09-cd57-4188-9fc1-e4d091136ffd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "POST /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0/action" status: 202 len: 0 microversion: 2.20 time: 0.140280 Jul 29 05:24:20.850048 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 188/403] 10.222.0.49 () {62 vars in 1319 bytes} [Fri Jul 29 05:24:20 2022] POST /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 29 05:24:20.862887 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-55ed2eed-6184-4c0d-9bf2-88e3825ccfc7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:20.863746 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-55ed2eed-6184-4c0d-9bf2-88e3825ccfc7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:20.872905 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-55ed2eed-6184-4c0d-9bf2-88e3825ccfc7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:20.873639 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-55ed2eed-6184-4c0d-9bf2-88e3825ccfc7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:20.874562 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-55ed2eed-6184-4c0d-9bf2-88e3825ccfc7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:20.875069 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-55ed2eed-6184-4c0d-9bf2-88e3825ccfc7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:21.048392 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-55ed2eed-6184-4c0d-9bf2-88e3825ccfc7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:21.057575 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-55ed2eed-6184-4c0d-9bf2-88e3825ccfc7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:21.059103 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-55ed2eed-6184-4c0d-9bf2-88e3825ccfc7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:21.060343 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-55ed2eed-6184-4c0d-9bf2-88e3825ccfc7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1749 microversion: 2.20 time: 0.202883 Jul 29 05:24:21.060906 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 216/404] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:20 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1749 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:24:21.496412 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-b09b5f4b-8cec-40fa-96e5-b6cf44048ce1 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:21.497653 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-b09b5f4b-8cec-40fa-96e5-b6cf44048ce1 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: 97bc6de7-a7b6-4f34-81f8-a1866a7eac99] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:21.504867 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b09b5f4b-8cec-40fa-96e5-b6cf44048ce1 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:21.505502 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b09b5f4b-8cec-40fa-96e5-b6cf44048ce1 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:21.506589 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b09b5f4b-8cec-40fa-96e5-b6cf44048ce1 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:21.507120 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b09b5f4b-8cec-40fa-96e5-b6cf44048ce1 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:21.726149 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-b09b5f4b-8cec-40fa-96e5-b6cf44048ce1 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:21.737475 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-b09b5f4b-8cec-40fa-96e5-b6cf44048ce1 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99" status: 200 len: 1314 microversion: 2.1 time: 0.246202 Jul 29 05:24:21.743419 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 189/405] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:21 2022] GET /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:22.084291 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-9ab0cebc-9b86-49a0-a798-1dc1d70417b7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:22.084879 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-9ab0cebc-9b86-49a0-a798-1dc1d70417b7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:22.092962 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9ab0cebc-9b86-49a0-a798-1dc1d70417b7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:22.093400 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9ab0cebc-9b86-49a0-a798-1dc1d70417b7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:22.094374 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9ab0cebc-9b86-49a0-a798-1dc1d70417b7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:22.094813 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9ab0cebc-9b86-49a0-a798-1dc1d70417b7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:22.255096 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-9ab0cebc-9b86-49a0-a798-1dc1d70417b7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:22.266930 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-9ab0cebc-9b86-49a0-a798-1dc1d70417b7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:22.269133 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-9ab0cebc-9b86-49a0-a798-1dc1d70417b7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:22.270861 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-9ab0cebc-9b86-49a0-a798-1dc1d70417b7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1749 microversion: 2.20 time: 0.190735 Jul 29 05:24:22.284847 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 217/406] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:22 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1749 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:24:22.761409 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-a4e4e4f3-3e36-43d2-b32f-38e76eac222e tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:22.762060 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-a4e4e4f3-3e36-43d2-b32f-38e76eac222e tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: 97bc6de7-a7b6-4f34-81f8-a1866a7eac99] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:22.768943 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a4e4e4f3-3e36-43d2-b32f-38e76eac222e tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:22.769395 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a4e4e4f3-3e36-43d2-b32f-38e76eac222e tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:22.770175 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a4e4e4f3-3e36-43d2-b32f-38e76eac222e tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:22.770649 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a4e4e4f3-3e36-43d2-b32f-38e76eac222e tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:22.807901 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell0:SELECT=2 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:24:22.946474 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-a4e4e4f3-3e36-43d2-b32f-38e76eac222e tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:22.960794 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-a4e4e4f3-3e36-43d2-b32f-38e76eac222e tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99" status: 200 len: 1314 microversion: 2.1 time: 0.202998 Jul 29 05:24:22.971703 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 190/407] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:22 2022] GET /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:24:23.298931 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-3b8474b5-5446-4dfd-bf08-ab6f4be2066d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:23.300147 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-3b8474b5-5446-4dfd-bf08-ab6f4be2066d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:23.302769 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell0:SELECT=2 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:24:23.303892 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell0:SELECT=6 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:24:23.311891 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3b8474b5-5446-4dfd-bf08-ab6f4be2066d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:23.312344 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3b8474b5-5446-4dfd-bf08-ab6f4be2066d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:23.313127 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3b8474b5-5446-4dfd-bf08-ab6f4be2066d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:23.313566 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3b8474b5-5446-4dfd-bf08-ab6f4be2066d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:23.470148 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-3b8474b5-5446-4dfd-bf08-ab6f4be2066d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:23.472432 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:24:23.481500 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-3b8474b5-5446-4dfd-bf08-ab6f4be2066d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:23.483037 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-3b8474b5-5446-4dfd-bf08-ab6f4be2066d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:23.484371 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-3b8474b5-5446-4dfd-bf08-ab6f4be2066d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1751 microversion: 2.20 time: 0.190515 Jul 29 05:24:23.485019 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 218/408] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:23 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1751 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:24:23.995671 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-6a9eff2e-b0c2-445c-a7d4-57cde2982362 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:23.996303 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-6a9eff2e-b0c2-445c-a7d4-57cde2982362 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: 97bc6de7-a7b6-4f34-81f8-a1866a7eac99] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:24.003712 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6a9eff2e-b0c2-445c-a7d4-57cde2982362 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:24.004163 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6a9eff2e-b0c2-445c-a7d4-57cde2982362 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:24.004938 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6a9eff2e-b0c2-445c-a7d4-57cde2982362 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:24.005371 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6a9eff2e-b0c2-445c-a7d4-57cde2982362 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:24.163246 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-6a9eff2e-b0c2-445c-a7d4-57cde2982362 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:24.184762 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-6a9eff2e-b0c2-445c-a7d4-57cde2982362 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99" status: 200 len: 1314 microversion: 2.1 time: 0.194000 Jul 29 05:24:24.185700 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 191/409] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:23 2022] GET /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:24.302766 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-e46030b1-491d-460b-a42c-cee3984912d7 req-cc068eec-f50d-482d-b546-003f4969b3e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97bc6de7-a7b6-4f34-81f8-a1866a7eac99", "name": "network-vif-plugged", "status": "completed", "tag": "8ffd92af-5f7d-4f45-9130-319553ac55db"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:24:24.311227 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:24:24.322883 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-e46030b1-491d-460b-a42c-cee3984912d7 req-cc068eec-f50d-482d-b546-003f4969b3e0 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:24.323616 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-e46030b1-491d-460b-a42c-cee3984912d7 req-cc068eec-f50d-482d-b546-003f4969b3e0 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:24.338825 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-e46030b1-491d-460b-a42c-cee3984912d7 req-cc068eec-f50d-482d-b546-003f4969b3e0 service nova] Creating event network-vif-plugged:8ffd92af-5f7d-4f45-9130-319553ac55db for instance 97bc6de7-a7b6-4f34-81f8-a1866a7eac99 on hv-cinder-85127 Jul 29 05:24:24.344565 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-e46030b1-491d-460b-a42c-cee3984912d7 req-cc068eec-f50d-482d-b546-003f4969b3e0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050295 Jul 29 05:24:24.345569 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 219/410] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:24:24.521140 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-04da183a-3dfa-439a-a13f-7eb4e1476066 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:24.521643 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-04da183a-3dfa-439a-a13f-7eb4e1476066 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:24.529661 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-04da183a-3dfa-439a-a13f-7eb4e1476066 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:24.530106 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-04da183a-3dfa-439a-a13f-7eb4e1476066 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:24.530949 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-04da183a-3dfa-439a-a13f-7eb4e1476066 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:24.531424 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-04da183a-3dfa-439a-a13f-7eb4e1476066 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:24.723841 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-04da183a-3dfa-439a-a13f-7eb4e1476066 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:24.734097 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-04da183a-3dfa-439a-a13f-7eb4e1476066 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:24.735662 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-04da183a-3dfa-439a-a13f-7eb4e1476066 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:24.736870 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-04da183a-3dfa-439a-a13f-7eb4e1476066 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1751 microversion: 2.20 time: 0.219831 Jul 29 05:24:24.737728 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 192/411] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:24 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1751 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:24:25.227867 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-33d3be19-6177-4147-8322-c8f87e5edcfa tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:25.229210 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-33d3be19-6177-4147-8322-c8f87e5edcfa tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: 97bc6de7-a7b6-4f34-81f8-a1866a7eac99] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:25.240823 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-33d3be19-6177-4147-8322-c8f87e5edcfa tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:25.241623 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-33d3be19-6177-4147-8322-c8f87e5edcfa tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:25.244438 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-33d3be19-6177-4147-8322-c8f87e5edcfa tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:25.245223 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-33d3be19-6177-4147-8322-c8f87e5edcfa tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:25.408720 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-33d3be19-6177-4147-8322-c8f87e5edcfa tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:25.416881 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-33d3be19-6177-4147-8322-c8f87e5edcfa tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99" status: 200 len: 1314 microversion: 2.1 time: 0.197723 Jul 29 05:24:25.417486 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 220/412] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:25 2022] GET /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:25.761819 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-06dcfb5c-0ceb-4e88-9b49-dbb62a2a212e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:25.762525 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-06dcfb5c-0ceb-4e88-9b49-dbb62a2a212e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:25.769726 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-06dcfb5c-0ceb-4e88-9b49-dbb62a2a212e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:25.770255 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-06dcfb5c-0ceb-4e88-9b49-dbb62a2a212e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:25.771094 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-06dcfb5c-0ceb-4e88-9b49-dbb62a2a212e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:25.771775 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-06dcfb5c-0ceb-4e88-9b49-dbb62a2a212e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:25.925862 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-06dcfb5c-0ceb-4e88-9b49-dbb62a2a212e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:25.936799 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-06dcfb5c-0ceb-4e88-9b49-dbb62a2a212e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:25.938462 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-06dcfb5c-0ceb-4e88-9b49-dbb62a2a212e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:25.939874 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-06dcfb5c-0ceb-4e88-9b49-dbb62a2a212e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1751 microversion: 2.20 time: 0.182815 Jul 29 05:24:25.940581 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 193/413] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:25 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1751 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:24:26.451283 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-34af8dc3-8dc2-493e-9590-791b662043e7 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:26.452309 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-34af8dc3-8dc2-493e-9590-791b662043e7 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: 97bc6de7-a7b6-4f34-81f8-a1866a7eac99] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:26.463839 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-34af8dc3-8dc2-493e-9590-791b662043e7 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:26.464572 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-34af8dc3-8dc2-493e-9590-791b662043e7 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:26.465964 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-34af8dc3-8dc2-493e-9590-791b662043e7 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:26.466754 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-34af8dc3-8dc2-493e-9590-791b662043e7 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:26.671750 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-34af8dc3-8dc2-493e-9590-791b662043e7 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:26.679846 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-34af8dc3-8dc2-493e-9590-791b662043e7 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99" status: 200 len: 1498 microversion: 2.1 time: 0.232672 Jul 29 05:24:26.680492 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 221/414] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:26 2022] GET /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99 => generated 1498 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:26.972978 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-b1eda100-595b-47b6-927a-39ea5ab8603b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:26.974106 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-b1eda100-595b-47b6-927a-39ea5ab8603b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:26.987948 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b1eda100-595b-47b6-927a-39ea5ab8603b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:26.988791 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b1eda100-595b-47b6-927a-39ea5ab8603b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:26.990147 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b1eda100-595b-47b6-927a-39ea5ab8603b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:26.990954 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b1eda100-595b-47b6-927a-39ea5ab8603b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:27.153820 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-b1eda100-595b-47b6-927a-39ea5ab8603b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:27.163950 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-b1eda100-595b-47b6-927a-39ea5ab8603b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:27.166385 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-b1eda100-595b-47b6-927a-39ea5ab8603b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:27.168311 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-b1eda100-595b-47b6-927a-39ea5ab8603b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1751 microversion: 2.20 time: 0.202798 Jul 29 05:24:27.169200 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 194/415] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:26 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1751 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:24:27.327792 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-3019b2c7-90f5-4391-95fc-78209bce0196 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:27.328297 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-3019b2c7-90f5-4391-95fc-78209bce0196 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: 97bc6de7-a7b6-4f34-81f8-a1866a7eac99] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:27.335384 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3019b2c7-90f5-4391-95fc-78209bce0196 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:27.335838 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3019b2c7-90f5-4391-95fc-78209bce0196 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:27.337128 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3019b2c7-90f5-4391-95fc-78209bce0196 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:27.337578 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3019b2c7-90f5-4391-95fc-78209bce0196 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:27.378813 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-3019b2c7-90f5-4391-95fc-78209bce0196 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: 97bc6de7-a7b6-4f34-81f8-a1866a7eac99] Going to try to terminate instance {{(pid=117821) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 05:24:27.479656 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-3019b2c7-90f5-4391-95fc-78209bce0196 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "DELETE /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99" status: 204 len: 0 microversion: 2.1 time: 0.156110 Jul 29 05:24:27.481005 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 222/416] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 05:24:27 2022] DELETE /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 05:24:27.489739 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-64ecc2aa-6d56-4016-afff-5c881836eb60 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:27.490663 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-64ecc2aa-6d56-4016-afff-5c881836eb60 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: 97bc6de7-a7b6-4f34-81f8-a1866a7eac99] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:27.498534 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-64ecc2aa-6d56-4016-afff-5c881836eb60 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:27.499142 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-64ecc2aa-6d56-4016-afff-5c881836eb60 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:27.500167 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-64ecc2aa-6d56-4016-afff-5c881836eb60 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:27.500593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-64ecc2aa-6d56-4016-afff-5c881836eb60 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:27.651758 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-64ecc2aa-6d56-4016-afff-5c881836eb60 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:27.661932 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-64ecc2aa-6d56-4016-afff-5c881836eb60 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99" status: 200 len: 1504 microversion: 2.1 time: 0.176133 Jul 29 05:24:27.662709 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 195/417] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:27 2022] GET /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99 => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:28.193636 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-2be376cb-b5c0-4ead-8c1d-3de84e2e34b2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:28.194493 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-2be376cb-b5c0-4ead-8c1d-3de84e2e34b2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:28.204589 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2be376cb-b5c0-4ead-8c1d-3de84e2e34b2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:28.204589 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2be376cb-b5c0-4ead-8c1d-3de84e2e34b2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:28.205404 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2be376cb-b5c0-4ead-8c1d-3de84e2e34b2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:28.205934 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2be376cb-b5c0-4ead-8c1d-3de84e2e34b2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:28.381716 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-2be376cb-b5c0-4ead-8c1d-3de84e2e34b2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:28.393544 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-2be376cb-b5c0-4ead-8c1d-3de84e2e34b2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:28.395187 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-2be376cb-b5c0-4ead-8c1d-3de84e2e34b2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:28.396428 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-2be376cb-b5c0-4ead-8c1d-3de84e2e34b2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1751 microversion: 2.20 time: 0.207343 Jul 29 05:24:28.397016 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 223/418] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:28 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1751 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:24:28.685461 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-b66c2b5f-63e7-4d0a-bade-af9dd298ab6f tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:28.686101 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-b66c2b5f-63e7-4d0a-bade-af9dd298ab6f tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: 97bc6de7-a7b6-4f34-81f8-a1866a7eac99] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:28.693711 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b66c2b5f-63e7-4d0a-bade-af9dd298ab6f tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:28.694215 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b66c2b5f-63e7-4d0a-bade-af9dd298ab6f tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:28.695051 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b66c2b5f-63e7-4d0a-bade-af9dd298ab6f tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:28.696181 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b66c2b5f-63e7-4d0a-bade-af9dd298ab6f tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:28.847163 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-b66c2b5f-63e7-4d0a-bade-af9dd298ab6f tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:28.855979 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-b66c2b5f-63e7-4d0a-bade-af9dd298ab6f tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99" status: 200 len: 1504 microversion: 2.1 time: 0.174356 Jul 29 05:24:28.856581 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 196/419] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:28 2022] GET /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99 => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:29.421212 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-f61dc549-16ec-4e08-8b16-ef0d01a7c6df tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:29.422082 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-f61dc549-16ec-4e08-8b16-ef0d01a7c6df tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:29.429157 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f61dc549-16ec-4e08-8b16-ef0d01a7c6df tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:29.429609 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f61dc549-16ec-4e08-8b16-ef0d01a7c6df tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:29.430391 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f61dc549-16ec-4e08-8b16-ef0d01a7c6df tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:29.430847 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f61dc549-16ec-4e08-8b16-ef0d01a7c6df tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:29.624353 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-f61dc549-16ec-4e08-8b16-ef0d01a7c6df tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:29.635819 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-f61dc549-16ec-4e08-8b16-ef0d01a7c6df tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:29.637432 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-f61dc549-16ec-4e08-8b16-ef0d01a7c6df tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:29.638664 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-f61dc549-16ec-4e08-8b16-ef0d01a7c6df tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1751 microversion: 2.20 time: 0.221478 Jul 29 05:24:29.639239 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 224/420] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:29 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1751 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:24:29.881618 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-246227d9-c113-4eb1-ace3-435cb801ae3f tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:29.882671 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-246227d9-c113-4eb1-ace3-435cb801ae3f tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: 97bc6de7-a7b6-4f34-81f8-a1866a7eac99] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:29.890105 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-246227d9-c113-4eb1-ace3-435cb801ae3f tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:29.890552 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-246227d9-c113-4eb1-ace3-435cb801ae3f tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:29.891332 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-246227d9-c113-4eb1-ace3-435cb801ae3f tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:29.891787 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-246227d9-c113-4eb1-ace3-435cb801ae3f tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:30.271607 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-246227d9-c113-4eb1-ace3-435cb801ae3f tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:30.285664 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-246227d9-c113-4eb1-ace3-435cb801ae3f tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99" status: 200 len: 1504 microversion: 2.1 time: 0.409125 Jul 29 05:24:30.297219 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 197/421] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:29 2022] GET /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99 => generated 1504 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:30.645261 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-b9048392-0c86-4876-8c03-4a98cc16c4e3 req-94ac42c2-05ac-4e9a-9ec5-633082d546cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97bc6de7-a7b6-4f34-81f8-a1866a7eac99", "name": "network-vif-deleted", "tag": "8ffd92af-5f7d-4f45-9130-319553ac55db"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:24:30.662334 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-b9048392-0c86-4876-8c03-4a98cc16c4e3 req-94ac42c2-05ac-4e9a-9ec5-633082d546cc service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:30.662665 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-d85f13c3-3b81-4589-b11b-e019f2c254e9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:30.663077 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-d85f13c3-3b81-4589-b11b-e019f2c254e9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:30.663276 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-b9048392-0c86-4876-8c03-4a98cc16c4e3 req-94ac42c2-05ac-4e9a-9ec5-633082d546cc service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:30.686241 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d85f13c3-3b81-4589-b11b-e019f2c254e9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:30.686818 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d85f13c3-3b81-4589-b11b-e019f2c254e9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:30.687903 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d85f13c3-3b81-4589-b11b-e019f2c254e9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:30.688532 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d85f13c3-3b81-4589-b11b-e019f2c254e9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:30.689429 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-b9048392-0c86-4876-8c03-4a98cc16c4e3 req-94ac42c2-05ac-4e9a-9ec5-633082d546cc service nova] Creating event network-vif-deleted:8ffd92af-5f7d-4f45-9130-319553ac55db for instance 97bc6de7-a7b6-4f34-81f8-a1866a7eac99 on hv-cinder-85127 Jul 29 05:24:30.701341 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-b9048392-0c86-4876-8c03-4a98cc16c4e3 req-94ac42c2-05ac-4e9a-9ec5-633082d546cc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060766 Jul 29 05:24:30.702393 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 225/422] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:24:30.897312 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-d85f13c3-3b81-4589-b11b-e019f2c254e9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:30.911246 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-d85f13c3-3b81-4589-b11b-e019f2c254e9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:30.914212 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-d85f13c3-3b81-4589-b11b-e019f2c254e9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:30.916194 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-d85f13c3-3b81-4589-b11b-e019f2c254e9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1807 microversion: 2.20 time: 0.257526 Jul 29 05:24:30.916808 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 198/423] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:30 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1807 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:24:31.313431 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-c8933809-98ef-440d-9db2-fa300fa8c70f tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:31.314146 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-c8933809-98ef-440d-9db2-fa300fa8c70f tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: 97bc6de7-a7b6-4f34-81f8-a1866a7eac99] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:31.322539 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c8933809-98ef-440d-9db2-fa300fa8c70f tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:31.323054 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c8933809-98ef-440d-9db2-fa300fa8c70f tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:31.324142 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c8933809-98ef-440d-9db2-fa300fa8c70f tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:31.324660 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c8933809-98ef-440d-9db2-fa300fa8c70f tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:31.364517 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c8933809-98ef-440d-9db2-fa300fa8c70f tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:31.364961 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c8933809-98ef-440d-9db2-fa300fa8c70f tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:31.365416 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.objects.instance [None req-c8933809-98ef-440d-9db2-fa300fa8c70f tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lazy-loading 'fault' on Instance uuid 97bc6de7-a7b6-4f34-81f8-a1866a7eac99 {{(pid=117821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:24:31.413870 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-c8933809-98ef-440d-9db2-fa300fa8c70f tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:31.426851 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-c8933809-98ef-440d-9db2-fa300fa8c70f tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99" status: 200 len: 1304 microversion: 2.1 time: 0.117824 Jul 29 05:24:31.427908 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 226/424] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:31 2022] GET /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99 => generated 1304 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:31.948050 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-75796173-8daf-4a0f-9bc1-6e1044485aff tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:31.948725 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-75796173-8daf-4a0f-9bc1-6e1044485aff tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:31.955776 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-75796173-8daf-4a0f-9bc1-6e1044485aff tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:31.956252 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-75796173-8daf-4a0f-9bc1-6e1044485aff tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:31.957500 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-75796173-8daf-4a0f-9bc1-6e1044485aff tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:31.957984 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-75796173-8daf-4a0f-9bc1-6e1044485aff tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:31.978500 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:24:32.120335 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-75796173-8daf-4a0f-9bc1-6e1044485aff tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:32.129999 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-75796173-8daf-4a0f-9bc1-6e1044485aff tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:32.131606 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-75796173-8daf-4a0f-9bc1-6e1044485aff tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:32.132999 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-75796173-8daf-4a0f-9bc1-6e1044485aff tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1807 microversion: 2.20 time: 0.189543 Jul 29 05:24:32.133772 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 199/425] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:31 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1807 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:24:32.464871 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-be01147c-6262-4b52-925f-43d8ba1f8797 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:32.465808 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-be01147c-6262-4b52-925f-43d8ba1f8797 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: 97bc6de7-a7b6-4f34-81f8-a1866a7eac99] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:32.472490 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-be01147c-6262-4b52-925f-43d8ba1f8797 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:32.472939 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-be01147c-6262-4b52-925f-43d8ba1f8797 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:32.473817 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-be01147c-6262-4b52-925f-43d8ba1f8797 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:32.474283 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-be01147c-6262-4b52-925f-43d8ba1f8797 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:32.532338 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-be01147c-6262-4b52-925f-43d8ba1f8797 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:32.533387 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-be01147c-6262-4b52-925f-43d8ba1f8797 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:32.534192 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.objects.instance [None req-be01147c-6262-4b52-925f-43d8ba1f8797 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lazy-loading 'fault' on Instance uuid 97bc6de7-a7b6-4f34-81f8-a1866a7eac99 {{(pid=117821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:24:32.583965 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-be01147c-6262-4b52-925f-43d8ba1f8797 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:32.593046 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-be01147c-6262-4b52-925f-43d8ba1f8797 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99" status: 200 len: 1304 microversion: 2.1 time: 0.132789 Jul 29 05:24:32.593647 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 227/426] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:32 2022] GET /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99 => generated 1304 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:33.175787 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-7c7278af-1477-4fbe-ae4d-024eb4d8e9eb tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:33.177726 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-7c7278af-1477-4fbe-ae4d-024eb4d8e9eb tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:33.188608 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7c7278af-1477-4fbe-ae4d-024eb4d8e9eb tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:33.189389 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7c7278af-1477-4fbe-ae4d-024eb4d8e9eb tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:33.190471 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7c7278af-1477-4fbe-ae4d-024eb4d8e9eb tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:33.191095 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7c7278af-1477-4fbe-ae4d-024eb4d8e9eb tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:33.395469 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-7c7278af-1477-4fbe-ae4d-024eb4d8e9eb tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:33.405942 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-7c7278af-1477-4fbe-ae4d-024eb4d8e9eb tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:33.407906 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-7c7278af-1477-4fbe-ae4d-024eb4d8e9eb tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:33.409113 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-7c7278af-1477-4fbe-ae4d-024eb4d8e9eb tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1807 microversion: 2.20 time: 0.240405 Jul 29 05:24:33.409670 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 200/427] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:33 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1807 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:24:33.616185 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-f80e3377-cbaf-4358-8098-b03372681bd3 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:33.616840 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-f80e3377-cbaf-4358-8098-b03372681bd3 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: 97bc6de7-a7b6-4f34-81f8-a1866a7eac99] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:33.624541 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f80e3377-cbaf-4358-8098-b03372681bd3 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:33.624998 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f80e3377-cbaf-4358-8098-b03372681bd3 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:33.625773 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f80e3377-cbaf-4358-8098-b03372681bd3 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:33.626207 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f80e3377-cbaf-4358-8098-b03372681bd3 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:33.641071 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.wsgi [None req-f80e3377-cbaf-4358-8098-b03372681bd3 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] HTTP exception thrown: Instance 97bc6de7-a7b6-4f34-81f8-a1866a7eac99 could not be found. Jul 29 05:24:33.642757 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-f80e3377-cbaf-4358-8098-b03372681bd3 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Request method failure captured: Jul 29 05:24:33.642757 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: request: GET /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99 HTTP/1.1 Jul 29 05:24:33.642757 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept: application/json Jul 29 05:24:33.642757 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept-Encoding: identity Jul 29 05:24:33.642757 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Connection: close Jul 29 05:24:33.642757 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Length: 0 Jul 29 05:24:33.642757 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Type: application/json Jul 29 05:24:33.642757 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Host: 10.222.0.49 Jul 29 05:24:33.642757 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Openstack-System-Scope: None Jul 29 05:24:33.642757 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: User-Agent: python-urllib3/1.26.10 Jul 29 05:24:33.642757 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Auth-Token: gAAAAABi42728gJ6PByW2mM82BOOwciKqw1i7pfyZbPY4MuaQxyGAipWgWZ0lQG46dWq-LEacwnQytrSQdmaAR3bKn3kirZ3oRrVhGo5umKBwwJeWQH-4orxAxU-A8mPZjverAQQumovE_PXI8_eFMTuVreQGexTQ_94eg46-mwk26tCDdMMbGQ Jul 29 05:24:33.642757 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Id: None Jul 29 05:24:33.642757 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Name: None Jul 29 05:24:33.642757 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Identity-Status: Confirmed Jul 29 05:24:33.642757 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Is-Admin-Project: True Jul 29 05:24:33.642757 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Id: default Jul 29 05:24:33.642757 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Name: Default Jul 29 05:24:33.642757 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Id: b28baf3f14f74766b11c9ee459b8d5ec Jul 29 05:24:33.642757 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Name: tempest-VolumesActionsTest-1877169005 Jul 29 05:24:33.642757 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Role: member,reader Jul 29 05:24:33.642757 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Roles: member,reader Jul 29 05:24:33.644324 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b28baf3f14f74766b11c9ee459b8d5ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b28baf3f14f74766b11c9ee459b8d5ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b28baf3f14f74766b11c9ee459b8d5ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b28baf3f14f74766b11c9ee459b8d5ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:24:33.644324 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant: tempest-VolumesActionsTest-1877169005 Jul 29 05:24:33.644324 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Id: b28baf3f14f74766b11c9ee459b8d5ec Jul 29 05:24:33.644324 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Name: tempest-VolumesActionsTest-1877169005 Jul 29 05:24:33.644324 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User: tempest-VolumesActionsTest-1877169005-project Jul 29 05:24:33.644324 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Id: default Jul 29 05:24:33.644324 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Name: Default Jul 29 05:24:33.644324 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Id: 27709d338705483b97997fcfd48d1d4a Jul 29 05:24:33.644324 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Name: tempest-VolumesActionsTest-1877169005-project Jul 29 05:24:33.644324 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: method: > Jul 29 05:24:33.644324 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: exception: Instance 97bc6de7-a7b6-4f34-81f8-a1866a7eac99 could not be found. Jul 29 05:24:33.644324 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: action_args: {'id': '97bc6de7-a7b6-4f34-81f8-a1866a7eac99'} Jul 29 05:24:33.645265 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:24:33.645265 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:24:33.645265 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:24:33.645265 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:24:33.645265 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:24:33.645265 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:24:33.645265 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:24:33.645265 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:24:33.645265 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:24:33.645265 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:24:33.645265 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97bc6de7-a7b6-4f34-81f8-a1866a7eac99 could not be found. Jul 29 05:24:33.645265 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:24:33.645265 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:24:33.645265 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:24:33.645265 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:24:33.645265 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:24:33.645265 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:24:33.645265 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:24:33.645265 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:24:33.645265 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:24:33.646972 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:24:33.646972 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:24:33.646972 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:24:33.646972 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:24:33.646972 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:24:33.646972 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:24:33.646972 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:24:33.646972 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97bc6de7-a7b6-4f34-81f8-a1866a7eac99 could not be found. Jul 29 05:24:33.646972 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:24:33.646972 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:24:33.646972 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:24:33.646972 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:24:33.646972 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:24:33.646972 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:24:33.646972 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:24:33.646972 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:24:33.646972 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97bc6de7-a7b6-4f34-81f8-a1866a7eac99 could not be found. Jul 29 05:24:33.646972 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:24:33.649037 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-f80e3377-cbaf-4358-8098-b03372681bd3 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Returning 404 to user: Instance 97bc6de7-a7b6-4f34-81f8-a1866a7eac99 could not be found. {{(pid=117821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:24:33.649037 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-f80e3377-cbaf-4358-8098-b03372681bd3 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99" status: 404 len: 111 microversion: 2.1 time: 0.032692 Jul 29 05:24:33.649037 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 228/428] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:33 2022] GET /compute/v2.1/servers/97bc6de7-a7b6-4f34-81f8-a1866a7eac99 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:24:33.721771 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-ef9a4582-fe3e-4ca0-bd51-b4d30bf03e08 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-375874256", "imageRef": "b7bf870d-4e7c-42fd-849f-72ac19277493", "flavorRef": "452", "networks": [{"uuid": "6d50987d-b297-4c09-b50b-2b3a4e60a74e"}]}} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:24:33.785227 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.network.neutron [None req-ef9a4582-fe3e-4ca0-bd51-b4d30bf03e08 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] validate_networks() for [('6d50987d-b297-4c09-b50b-2b3a4e60a74e', None, None, None, None, None)] {{(pid=117820) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 05:24:34.391321 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-ef9a4582-fe3e-4ca0-bd51-b4d30bf03e08 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Flavor limits 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 05:24:34.392185 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-ef9a4582-fe3e-4ca0-bd51-b4d30bf03e08 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Image limits 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 05:24:34.393197 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-ef9a4582-fe3e-4ca0-bd51-b4d30bf03e08 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Flavor pref 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 05:24:34.394105 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-ef9a4582-fe3e-4ca0-bd51-b4d30bf03e08 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Image pref 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 05:24:34.394884 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-ef9a4582-fe3e-4ca0-bd51-b4d30bf03e08 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 05:24:34.412278 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ef9a4582-fe3e-4ca0-bd51-b4d30bf03e08 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:34.413077 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ef9a4582-fe3e-4ca0-bd51-b4d30bf03e08 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:34.414579 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ef9a4582-fe3e-4ca0-bd51-b4d30bf03e08 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:34.415524 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ef9a4582-fe3e-4ca0-bd51-b4d30bf03e08 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:34.434679 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-2a39b653-6018-4ca3-a563-ec750baccf94 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:34.435309 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-2a39b653-6018-4ca3-a563-ec750baccf94 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:34.442186 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2a39b653-6018-4ca3-a563-ec750baccf94 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:34.442648 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2a39b653-6018-4ca3-a563-ec750baccf94 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:34.443522 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2a39b653-6018-4ca3-a563-ec750baccf94 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:34.443857 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2a39b653-6018-4ca3-a563-ec750baccf94 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:34.451125 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.quota [None req-ef9a4582-fe3e-4ca0-bd51-b4d30bf03e08 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Getting quotas for project b28baf3f14f74766b11c9ee459b8d5ec. Resources: {'instances', 'ram', 'cores'} {{(pid=117820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:24:34.458774 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.quota [None req-ef9a4582-fe3e-4ca0-bd51-b4d30bf03e08 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Getting quotas for user 27709d338705483b97997fcfd48d1d4a and project b28baf3f14f74766b11c9ee459b8d5ec. Resources: {'instances', 'ram', 'cores'} {{(pid=117820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:24:34.482472 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-ef9a4582-fe3e-4ca0-bd51-b4d30bf03e08 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Going to run 1 instances... {{(pid=117820) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 05:24:34.487570 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-ef9a4582-fe3e-4ca0-bd51-b4d30bf03e08 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: dbc57534-e5bb-434a-a446-eb402deff943] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b7bf870d-4e7c-42fd-849f-72ac19277493',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117820) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 05:24:34.565531 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-ef9a4582-fe3e-4ca0-bd51-b4d30bf03e08 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.847260 Jul 29 05:24:34.577781 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 201/429] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 05:24:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 05:24:34.590373 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-5ff084a1-a2da-4e48-b6ff-70cfd41a252d tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:34.591722 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-5ff084a1-a2da-4e48-b6ff-70cfd41a252d tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: dbc57534-e5bb-434a-a446-eb402deff943] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:34.671134 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-2a39b653-6018-4ca3-a563-ec750baccf94 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:34.688842 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-2a39b653-6018-4ca3-a563-ec750baccf94 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:34.692241 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-2a39b653-6018-4ca3-a563-ec750baccf94 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:34.708065 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-2a39b653-6018-4ca3-a563-ec750baccf94 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1807 microversion: 2.20 time: 0.264561 Jul 29 05:24:34.721239 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 229/430] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:34 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1807 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:24:34.722533 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-5ff084a1-a2da-4e48-b6ff-70cfd41a252d tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:34.722533 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-5ff084a1-a2da-4e48-b6ff-70cfd41a252d tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943" status: 200 len: 1213 microversion: 2.1 time: 0.140079 Jul 29 05:24:34.722533 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 202/431] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:34 2022] GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943 => generated 1213 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:35.754942 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-5676696c-7e50-41d9-8991-53bb3d467be1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:35.756059 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-5676696c-7e50-41d9-8991-53bb3d467be1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:35.756815 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-38f28fe5-466d-4075-b668-af2602c2917f tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:35.760356 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-38f28fe5-466d-4075-b668-af2602c2917f tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: dbc57534-e5bb-434a-a446-eb402deff943] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:35.772486 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5676696c-7e50-41d9-8991-53bb3d467be1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:35.773768 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5676696c-7e50-41d9-8991-53bb3d467be1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:35.779322 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5676696c-7e50-41d9-8991-53bb3d467be1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:35.787168 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-38f28fe5-466d-4075-b668-af2602c2917f tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:35.792814 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-38f28fe5-466d-4075-b668-af2602c2917f tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:35.794593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5676696c-7e50-41d9-8991-53bb3d467be1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:35.796824 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-38f28fe5-466d-4075-b668-af2602c2917f tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:35.798744 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-38f28fe5-466d-4075-b668-af2602c2917f tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:35.942733 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-38f28fe5-466d-4075-b668-af2602c2917f tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:35.967768 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-38f28fe5-466d-4075-b668-af2602c2917f tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943" status: 200 len: 1209 microversion: 2.1 time: 0.228142 Jul 29 05:24:35.983765 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 230/432] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:35 2022] GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943 => generated 1209 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:36.123727 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-5676696c-7e50-41d9-8991-53bb3d467be1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:36.134211 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-5676696c-7e50-41d9-8991-53bb3d467be1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:36.136208 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-5676696c-7e50-41d9-8991-53bb3d467be1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:36.137440 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-5676696c-7e50-41d9-8991-53bb3d467be1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1807 microversion: 2.20 time: 0.389724 Jul 29 05:24:36.145515 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 203/433] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:35 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1807 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:24:36.996236 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-97983e73-2947-4555-8ce8-c2c69ae299a6 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:36.997550 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-97983e73-2947-4555-8ce8-c2c69ae299a6 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: dbc57534-e5bb-434a-a446-eb402deff943] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:37.011606 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-97983e73-2947-4555-8ce8-c2c69ae299a6 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:37.012727 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-97983e73-2947-4555-8ce8-c2c69ae299a6 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:37.014370 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-97983e73-2947-4555-8ce8-c2c69ae299a6 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:37.015419 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-97983e73-2947-4555-8ce8-c2c69ae299a6 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:37.108598 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-97983e73-2947-4555-8ce8-c2c69ae299a6 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:37.117627 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-97983e73-2947-4555-8ce8-c2c69ae299a6 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943" status: 200 len: 1209 microversion: 2.1 time: 0.129772 Jul 29 05:24:37.118225 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 231/434] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:36 2022] GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943 => generated 1209 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:37.180183 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-f2b5d64a-3ed6-44b6-b580-68bc919f9bef tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:37.181497 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-f2b5d64a-3ed6-44b6-b580-68bc919f9bef tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:37.199482 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f2b5d64a-3ed6-44b6-b580-68bc919f9bef tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:37.200579 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f2b5d64a-3ed6-44b6-b580-68bc919f9bef tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:37.202174 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f2b5d64a-3ed6-44b6-b580-68bc919f9bef tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:37.202965 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f2b5d64a-3ed6-44b6-b580-68bc919f9bef tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:37.483388 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-f2b5d64a-3ed6-44b6-b580-68bc919f9bef tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:37.495073 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-f2b5d64a-3ed6-44b6-b580-68bc919f9bef tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:37.496734 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-f2b5d64a-3ed6-44b6-b580-68bc919f9bef tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:37.498045 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-f2b5d64a-3ed6-44b6-b580-68bc919f9bef tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1807 microversion: 2.20 time: 0.324918 Jul 29 05:24:37.511939 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 204/435] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:37 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1807 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:24:38.146062 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-7601f3db-94a3-452d-a73c-1f4a6d5e05eb tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:38.149308 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-7601f3db-94a3-452d-a73c-1f4a6d5e05eb tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: dbc57534-e5bb-434a-a446-eb402deff943] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:38.162956 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7601f3db-94a3-452d-a73c-1f4a6d5e05eb tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:38.165101 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7601f3db-94a3-452d-a73c-1f4a6d5e05eb tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:38.166910 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7601f3db-94a3-452d-a73c-1f4a6d5e05eb tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:38.167846 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7601f3db-94a3-452d-a73c-1f4a6d5e05eb tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:38.272159 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-7601f3db-94a3-452d-a73c-1f4a6d5e05eb tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:38.281599 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-7601f3db-94a3-452d-a73c-1f4a6d5e05eb tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943" status: 200 len: 1209 microversion: 2.1 time: 0.144258 Jul 29 05:24:38.282374 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 232/436] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:38 2022] GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943 => generated 1209 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:38.524685 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-fc02d2d4-efe9-438d-94d1-13d2a6bc41b3 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:38.526531 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-fc02d2d4-efe9-438d-94d1-13d2a6bc41b3 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:38.535212 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-fc02d2d4-efe9-438d-94d1-13d2a6bc41b3 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:38.535841 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-fc02d2d4-efe9-438d-94d1-13d2a6bc41b3 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:38.536820 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-fc02d2d4-efe9-438d-94d1-13d2a6bc41b3 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:38.537355 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-fc02d2d4-efe9-438d-94d1-13d2a6bc41b3 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:38.751959 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-fc02d2d4-efe9-438d-94d1-13d2a6bc41b3 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:38.761824 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-fc02d2d4-efe9-438d-94d1-13d2a6bc41b3 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:38.763313 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-fc02d2d4-efe9-438d-94d1-13d2a6bc41b3 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:38.764592 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-fc02d2d4-efe9-438d-94d1-13d2a6bc41b3 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1807 microversion: 2.20 time: 0.245881 Jul 29 05:24:38.765147 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 205/437] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:38 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1807 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:24:39.310243 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-9d9777cb-8754-4a33-8c95-78c0e7a089f4 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:39.311294 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-9d9777cb-8754-4a33-8c95-78c0e7a089f4 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: dbc57534-e5bb-434a-a446-eb402deff943] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:39.322039 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9d9777cb-8754-4a33-8c95-78c0e7a089f4 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:39.323169 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9d9777cb-8754-4a33-8c95-78c0e7a089f4 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:39.324567 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9d9777cb-8754-4a33-8c95-78c0e7a089f4 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:39.325657 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9d9777cb-8754-4a33-8c95-78c0e7a089f4 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:39.422393 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-9d9777cb-8754-4a33-8c95-78c0e7a089f4 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:39.431289 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-9d9777cb-8754-4a33-8c95-78c0e7a089f4 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943" status: 200 len: 1209 microversion: 2.1 time: 0.128474 Jul 29 05:24:39.431915 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 233/438] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:39 2022] GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943 => generated 1209 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:39.729911 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-944d3597-1599-4dae-9cc6-840141079773 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:39.730728 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-944d3597-1599-4dae-9cc6-840141079773 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: b11929b6-7818-4cae-be4e-8941c93c6aca] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:39.733099 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:24:39.739336 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-944d3597-1599-4dae-9cc6-840141079773 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:39.739921 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-944d3597-1599-4dae-9cc6-840141079773 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:39.741063 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-944d3597-1599-4dae-9cc6-840141079773 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:39.741910 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-944d3597-1599-4dae-9cc6-840141079773 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:39.787017 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-944d3597-1599-4dae-9cc6-840141079773 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca/ips" status: 200 len: 149 microversion: 2.1 time: 0.060926 Jul 29 05:24:39.788103 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 206/439] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Jul 29 05:24:39 2022] GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca/ips => generated 149 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:24:39.805640 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-dddc71a2-681b-4f2c-bba3-3e7e4e69ca0d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:39.806666 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-d6b77dbd-c705-4614-9ef0-8d46d6fccaf9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45636d85-9505-4a58-808a-cc8312d325b5"}} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:24:39.807762 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-dddc71a2-681b-4f2c-bba3-3e7e4e69ca0d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:39.810994 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-d6b77dbd-c705-4614-9ef0-8d46d6fccaf9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: b11929b6-7818-4cae-be4e-8941c93c6aca] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:39.821314 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-dddc71a2-681b-4f2c-bba3-3e7e4e69ca0d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:39.822977 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-dddc71a2-681b-4f2c-bba3-3e7e4e69ca0d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:39.825292 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-dddc71a2-681b-4f2c-bba3-3e7e4e69ca0d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:39.826557 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-dddc71a2-681b-4f2c-bba3-3e7e4e69ca0d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:39.829428 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d6b77dbd-c705-4614-9ef0-8d46d6fccaf9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:39.830208 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d6b77dbd-c705-4614-9ef0-8d46d6fccaf9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:39.832145 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d6b77dbd-c705-4614-9ef0-8d46d6fccaf9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:39.833138 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d6b77dbd-c705-4614-9ef0-8d46d6fccaf9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:40.078929 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.wsgi [None req-d6b77dbd-c705-4614-9ef0-8d46d6fccaf9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] HTTP exception thrown: Invalid volume: volume 45636d85-9505-4a58-808a-cc8312d325b5 is already attached to instances: 05c46947-e368-441d-9e07-584e95d55780 Jul 29 05:24:40.080827 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-d6b77dbd-c705-4614-9ef0-8d46d6fccaf9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Request method failure captured: Jul 29 05:24:40.080827 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: request: POST /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca/os-volume_attachments HTTP/1.1 Jul 29 05:24:40.080827 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept: application/json Jul 29 05:24:40.080827 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept-Encoding: identity Jul 29 05:24:40.080827 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Connection: close Jul 29 05:24:40.080827 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Length: 74 Jul 29 05:24:40.080827 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Type: application/json Jul 29 05:24:40.080827 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Host: 10.222.0.49 Jul 29 05:24:40.080827 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Openstack-System-Scope: None Jul 29 05:24:40.080827 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: User-Agent: python-urllib3/1.26.10 Jul 29 05:24:40.080827 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Auth-Token: gAAAAABi425JZwki5zTQDTC3iukDv4VCbNzlxQK73dr9mClVYcp-Pvpl82CYunlqvLixJfXv6lMCmXCQFs-hx71b40CIPEvZNAkIclM8nEjPEEMC1q8Qnidc9zW9MB-6S0Nkj4s67ZnGkNw0VjcX1sLTyzzsa2KGY_dj5NlUwZaoPl1fActyKvM Jul 29 05:24:40.080827 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Id: None Jul 29 05:24:40.080827 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Name: None Jul 29 05:24:40.080827 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Identity-Status: Confirmed Jul 29 05:24:40.080827 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Is-Admin-Project: True Jul 29 05:24:40.080827 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Id: default Jul 29 05:24:40.080827 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Name: Default Jul 29 05:24:40.080827 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Id: 9d8baaf2e23546ee8ed1de278617c7d2 Jul 29 05:24:40.080827 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Name: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:24:40.080827 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Role: member,reader Jul 29 05:24:40.080827 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Roles: member,reader Jul 29 05:24:40.082227 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:24:40.082227 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:24:40.082227 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Id: 9d8baaf2e23546ee8ed1de278617c7d2 Jul 29 05:24:40.082227 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:24:40.082227 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User: tempest-AttachVolumeNegativeTest-480684510-project Jul 29 05:24:40.082227 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Id: default Jul 29 05:24:40.082227 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Name: Default Jul 29 05:24:40.082227 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Id: 3c60b3a983f14f50b1b762a3954a1059 Jul 29 05:24:40.082227 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Name: tempest-AttachVolumeNegativeTest-480684510-project Jul 29 05:24:40.082227 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Jul 29 05:24:40.082227 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: {"volumeAttachment": {"volumeId": "45636d85-9505-4a58-808a-cc8312d325b5"}} Jul 29 05:24:40.082227 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: method: > Jul 29 05:24:40.083035 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: exception: Invalid volume: volume 45636d85-9505-4a58-808a-cc8312d325b5 is already attached to instances: 05c46947-e368-441d-9e07-584e95d55780 Jul 29 05:24:40.083035 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: action_args: {'server_id': 'b11929b6-7818-4cae-be4e-8941c93c6aca', 'body': {'volumeAttachment': {'volumeId': '45636d85-9505-4a58-808a-cc8312d325b5'}}} Jul 29 05:24:40.083035 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:24:40.083035 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:24:40.083035 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 29 05:24:40.083035 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 29 05:24:40.083035 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 29 05:24:40.083035 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 29 05:24:40.083035 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 29 05:24:40.083035 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 29 05:24:40.083035 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Jul 29 05:24:40.083035 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 29 05:24:40.083035 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Jul 29 05:24:40.083035 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 29 05:24:40.083035 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 45636d85-9505-4a58-808a-cc8312d325b5 is already attached to instances: 05c46947-e368-441d-9e07-584e95d55780 Jul 29 05:24:40.083035 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:24:40.083035 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:24:40.083035 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:24:40.083035 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:24:40.085196 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:24:40.085196 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:24:40.085196 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:24:40.085196 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:24:40.085196 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:24:40.085196 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:24:40.085196 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 05:24:40.085196 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 05:24:40.085196 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 05:24:40.085196 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 05:24:40.085196 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 05:24:40.085196 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 05:24:40.085196 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 29 05:24:40.085196 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 29 05:24:40.085196 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 45636d85-9505-4a58-808a-cc8312d325b5 is already attached to instances: 05c46947-e368-441d-9e07-584e95d55780 Jul 29 05:24:40.085196 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:24:40.085196 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:24:40.085196 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:24:40.085196 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:24:40.085196 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:24:40.088421 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:24:40.088421 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:24:40.088421 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:24:40.088421 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 45636d85-9505-4a58-808a-cc8312d325b5 is already attached to instances: 05c46947-e368-441d-9e07-584e95d55780 Jul 29 05:24:40.088421 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:24:40.088421 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-d6b77dbd-c705-4614-9ef0-8d46d6fccaf9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Returning 400 to user: Invalid volume: volume 45636d85-9505-4a58-808a-cc8312d325b5 is already attached to instances: 05c46947-e368-441d-9e07-584e95d55780 {{(pid=117821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:24:40.088421 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-d6b77dbd-c705-4614-9ef0-8d46d6fccaf9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "POST /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.283838 Jul 29 05:24:40.088421 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 234/440] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Jul 29 05:24:39 2022] POST /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca/os-volume_attachments => generated 174 bytes in 286 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 29 05:24:40.094564 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-3e94ac51-d124-4289-b43b-5e153e5ff23e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:40.095067 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-3e94ac51-d124-4289-b43b-5e153e5ff23e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: b11929b6-7818-4cae-be4e-8941c93c6aca] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:40.120918 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3e94ac51-d124-4289-b43b-5e153e5ff23e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:40.126354 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-dddc71a2-681b-4f2c-bba3-3e7e4e69ca0d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:40.126559 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3e94ac51-d124-4289-b43b-5e153e5ff23e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:40.126559 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3e94ac51-d124-4289-b43b-5e153e5ff23e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:40.126559 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3e94ac51-d124-4289-b43b-5e153e5ff23e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:40.135112 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-dddc71a2-681b-4f2c-bba3-3e7e4e69ca0d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:40.137465 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-dddc71a2-681b-4f2c-bba3-3e7e4e69ca0d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:40.138841 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-dddc71a2-681b-4f2c-bba3-3e7e4e69ca0d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1807 microversion: 2.20 time: 0.338094 Jul 29 05:24:40.139859 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 207/441] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:39 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1807 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:24:40.154756 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:24:40.160936 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-3e94ac51-d124-4289-b43b-5e153e5ff23e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: b11929b6-7818-4cae-be4e-8941c93c6aca] Going to try to terminate instance {{(pid=117821) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 05:24:40.316403 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-3e94ac51-d124-4289-b43b-5e153e5ff23e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca" status: 204 len: 0 microversion: 2.1 time: 0.216707 Jul 29 05:24:40.316403 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 235/442] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 05:24:40 2022] DELETE /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 29 05:24:40.322662 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-f13c92d2-374d-4704-9e72-bbebeb151134 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:40.323515 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-f13c92d2-374d-4704-9e72-bbebeb151134 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: b11929b6-7818-4cae-be4e-8941c93c6aca] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:40.333137 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f13c92d2-374d-4704-9e72-bbebeb151134 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:40.333745 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f13c92d2-374d-4704-9e72-bbebeb151134 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:40.334687 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f13c92d2-374d-4704-9e72-bbebeb151134 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:40.335137 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f13c92d2-374d-4704-9e72-bbebeb151134 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:40.457123 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-e17e893a-4172-4166-bc35-c2a40e2efdcc tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:40.457931 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-e17e893a-4172-4166-bc35-c2a40e2efdcc tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: dbc57534-e5bb-434a-a446-eb402deff943] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:40.474524 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e17e893a-4172-4166-bc35-c2a40e2efdcc tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:40.475033 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e17e893a-4172-4166-bc35-c2a40e2efdcc tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:40.476469 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e17e893a-4172-4166-bc35-c2a40e2efdcc tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:40.477669 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e17e893a-4172-4166-bc35-c2a40e2efdcc tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:40.581514 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-f13c92d2-374d-4704-9e72-bbebeb151134 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:40.584961 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-e17e893a-4172-4166-bc35-c2a40e2efdcc tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:40.594653 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-e17e893a-4172-4166-bc35-c2a40e2efdcc tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943" status: 200 len: 1209 microversion: 2.1 time: 0.143020 Jul 29 05:24:40.595088 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-f13c92d2-374d-4704-9e72-bbebeb151134 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca" status: 200 len: 1679 microversion: 2.1 time: 0.277041 Jul 29 05:24:40.596491 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 236/443] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:40 2022] GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943 => generated 1209 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:24:40.596663 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 208/444] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:40 2022] GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca => generated 1679 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:24:41.186307 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-2732a781-5d0f-4c6b-8ff0-d8489f12bdc8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:41.187958 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-2732a781-5d0f-4c6b-8ff0-d8489f12bdc8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:41.200183 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2732a781-5d0f-4c6b-8ff0-d8489f12bdc8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:41.201571 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2732a781-5d0f-4c6b-8ff0-d8489f12bdc8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:41.203226 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2732a781-5d0f-4c6b-8ff0-d8489f12bdc8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:41.204296 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2732a781-5d0f-4c6b-8ff0-d8489f12bdc8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:41.470226 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-2732a781-5d0f-4c6b-8ff0-d8489f12bdc8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:41.482417 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-2732a781-5d0f-4c6b-8ff0-d8489f12bdc8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:41.484332 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-2732a781-5d0f-4c6b-8ff0-d8489f12bdc8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:41.485814 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-2732a781-5d0f-4c6b-8ff0-d8489f12bdc8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1807 microversion: 2.20 time: 0.307590 Jul 29 05:24:41.486812 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 237/445] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:41 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1807 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:24:41.626656 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-8975745d-f764-4b05-8107-2142091a062d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:41.627757 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-8975745d-f764-4b05-8107-2142091a062d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: b11929b6-7818-4cae-be4e-8941c93c6aca] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:41.628031 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-6f70ef38-9ac6-49ff-ab56-bedccb22f0fd tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:41.629342 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-6f70ef38-9ac6-49ff-ab56-bedccb22f0fd tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: dbc57534-e5bb-434a-a446-eb402deff943] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:41.637052 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8975745d-f764-4b05-8107-2142091a062d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:41.637590 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8975745d-f764-4b05-8107-2142091a062d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:41.638308 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8975745d-f764-4b05-8107-2142091a062d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:41.638754 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8975745d-f764-4b05-8107-2142091a062d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:41.642902 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6f70ef38-9ac6-49ff-ab56-bedccb22f0fd tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:41.643737 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6f70ef38-9ac6-49ff-ab56-bedccb22f0fd tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:41.645178 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6f70ef38-9ac6-49ff-ab56-bedccb22f0fd tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:41.646031 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6f70ef38-9ac6-49ff-ab56-bedccb22f0fd tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:41.828731 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-6f70ef38-9ac6-49ff-ab56-bedccb22f0fd tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:41.853254 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-6f70ef38-9ac6-49ff-ab56-bedccb22f0fd tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943" status: 200 len: 1209 microversion: 2.1 time: 0.233383 Jul 29 05:24:41.854231 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 238/446] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:41 2022] GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943 => generated 1209 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:41.932224 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-8975745d-f764-4b05-8107-2142091a062d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:41.951737 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-8975745d-f764-4b05-8107-2142091a062d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca" status: 200 len: 1679 microversion: 2.1 time: 0.331628 Jul 29 05:24:41.956675 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 209/447] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:41 2022] GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca => generated 1679 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:42.515090 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-a331846d-ee4d-4285-9262-72217f17bb0d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:42.516277 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-a331846d-ee4d-4285-9262-72217f17bb0d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:42.525367 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a331846d-ee4d-4285-9262-72217f17bb0d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:42.526216 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a331846d-ee4d-4285-9262-72217f17bb0d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:42.527748 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a331846d-ee4d-4285-9262-72217f17bb0d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:42.528569 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a331846d-ee4d-4285-9262-72217f17bb0d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:42.780582 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-a331846d-ee4d-4285-9262-72217f17bb0d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:42.796038 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-a331846d-ee4d-4285-9262-72217f17bb0d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:42.799159 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-a331846d-ee4d-4285-9262-72217f17bb0d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:42.801339 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-a331846d-ee4d-4285-9262-72217f17bb0d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1807 microversion: 2.20 time: 0.293508 Jul 29 05:24:42.802319 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 239/448] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:42 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1807 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:24:42.895074 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-ae246b94-ec69-4d4e-ba10-6c2ec0165c39 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:42.896311 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-ae246b94-ec69-4d4e-ba10-6c2ec0165c39 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: dbc57534-e5bb-434a-a446-eb402deff943] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:42.905896 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ae246b94-ec69-4d4e-ba10-6c2ec0165c39 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:42.906660 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ae246b94-ec69-4d4e-ba10-6c2ec0165c39 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:42.907919 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ae246b94-ec69-4d4e-ba10-6c2ec0165c39 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:42.908518 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ae246b94-ec69-4d4e-ba10-6c2ec0165c39 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:43.004693 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-353b5bcb-789b-4ba1-87ac-b3121066e5b9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:43.006186 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-353b5bcb-789b-4ba1-87ac-b3121066e5b9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: b11929b6-7818-4cae-be4e-8941c93c6aca] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:43.020591 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-353b5bcb-789b-4ba1-87ac-b3121066e5b9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:43.022004 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-353b5bcb-789b-4ba1-87ac-b3121066e5b9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:43.023683 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-ae246b94-ec69-4d4e-ba10-6c2ec0165c39 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:43.027704 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-353b5bcb-789b-4ba1-87ac-b3121066e5b9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:43.030341 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-353b5bcb-789b-4ba1-87ac-b3121066e5b9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:43.038974 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-ae246b94-ec69-4d4e-ba10-6c2ec0165c39 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943" status: 200 len: 1209 microversion: 2.1 time: 0.147719 Jul 29 05:24:43.045434 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 210/449] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:42 2022] GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943 => generated 1209 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:43.283595 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-353b5bcb-789b-4ba1-87ac-b3121066e5b9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:43.297417 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-353b5bcb-789b-4ba1-87ac-b3121066e5b9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca" status: 200 len: 1679 microversion: 2.1 time: 0.302067 Jul 29 05:24:43.298359 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 240/450] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:42 2022] GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca => generated 1679 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:43.841652 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-fdaa15a4-715a-4247-8442-4f97673e997b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:43.843166 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-fdaa15a4-715a-4247-8442-4f97673e997b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:43.855455 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-fdaa15a4-715a-4247-8442-4f97673e997b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:43.856210 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-fdaa15a4-715a-4247-8442-4f97673e997b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:43.859027 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-fdaa15a4-715a-4247-8442-4f97673e997b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:43.859786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-fdaa15a4-715a-4247-8442-4f97673e997b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:44.079651 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-b3764bec-9769-4862-8bc2-65057a8f6734 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:44.080722 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-b3764bec-9769-4862-8bc2-65057a8f6734 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: dbc57534-e5bb-434a-a446-eb402deff943] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:44.094476 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b3764bec-9769-4862-8bc2-65057a8f6734 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:44.095158 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b3764bec-9769-4862-8bc2-65057a8f6734 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:44.096819 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b3764bec-9769-4862-8bc2-65057a8f6734 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:44.097860 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b3764bec-9769-4862-8bc2-65057a8f6734 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:44.275232 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-b3764bec-9769-4862-8bc2-65057a8f6734 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:44.295008 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-b3764bec-9769-4862-8bc2-65057a8f6734 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943" status: 200 len: 1209 microversion: 2.1 time: 0.223094 Jul 29 05:24:44.296687 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 241/451] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:44 2022] GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943 => generated 1209 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:44.333593 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-dc8ac7ea-e4c3-4f56-8cab-14aa0c69f3d3 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:44.334799 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-dc8ac7ea-e4c3-4f56-8cab-14aa0c69f3d3 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: b11929b6-7818-4cae-be4e-8941c93c6aca] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:44.347421 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-dc8ac7ea-e4c3-4f56-8cab-14aa0c69f3d3 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:44.348276 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-dc8ac7ea-e4c3-4f56-8cab-14aa0c69f3d3 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:44.349851 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-dc8ac7ea-e4c3-4f56-8cab-14aa0c69f3d3 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:44.351389 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-dc8ac7ea-e4c3-4f56-8cab-14aa0c69f3d3 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:44.430998 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell0:SELECT=2 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:24:44.489769 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-fdaa15a4-715a-4247-8442-4f97673e997b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:44.501012 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-fdaa15a4-715a-4247-8442-4f97673e997b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:44.502986 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-fdaa15a4-715a-4247-8442-4f97673e997b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:44.504423 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-fdaa15a4-715a-4247-8442-4f97673e997b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1807 microversion: 2.20 time: 0.669012 Jul 29 05:24:44.505083 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 211/452] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:43 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1807 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:24:44.699952 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-dc8ac7ea-e4c3-4f56-8cab-14aa0c69f3d3 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:44.728758 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-dc8ac7ea-e4c3-4f56-8cab-14aa0c69f3d3 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca" status: 200 len: 1679 microversion: 2.1 time: 0.402783 Jul 29 05:24:44.729798 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 242/453] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:44 2022] GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca => generated 1679 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:24:45.337090 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-f1decf03-e5f2-47c7-98fa-63cb5f2ab052 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:45.337823 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-f1decf03-e5f2-47c7-98fa-63cb5f2ab052 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: dbc57534-e5bb-434a-a446-eb402deff943] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:45.339819 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell0:SELECT=8 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:24:45.347662 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f1decf03-e5f2-47c7-98fa-63cb5f2ab052 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:45.348224 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f1decf03-e5f2-47c7-98fa-63cb5f2ab052 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:45.349055 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f1decf03-e5f2-47c7-98fa-63cb5f2ab052 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:45.349501 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f1decf03-e5f2-47c7-98fa-63cb5f2ab052 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:45.422329 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-f1decf03-e5f2-47c7-98fa-63cb5f2ab052 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:45.431023 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-f1decf03-e5f2-47c7-98fa-63cb5f2ab052 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943" status: 200 len: 1209 microversion: 2.1 time: 0.098399 Jul 29 05:24:45.431746 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 212/454] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:45 2022] GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943 => generated 1209 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:45.530181 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-8aaff4b1-dd96-49fa-b47d-1a4377870441 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:45.530795 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-8aaff4b1-dd96-49fa-b47d-1a4377870441 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:45.537887 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8aaff4b1-dd96-49fa-b47d-1a4377870441 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:45.538316 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8aaff4b1-dd96-49fa-b47d-1a4377870441 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:45.539499 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8aaff4b1-dd96-49fa-b47d-1a4377870441 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:45.539943 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8aaff4b1-dd96-49fa-b47d-1a4377870441 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:45.682031 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-8aaff4b1-dd96-49fa-b47d-1a4377870441 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:45.690976 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-8aaff4b1-dd96-49fa-b47d-1a4377870441 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:45.692543 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-8aaff4b1-dd96-49fa-b47d-1a4377870441 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:45.693747 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-8aaff4b1-dd96-49fa-b47d-1a4377870441 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1807 microversion: 2.20 time: 0.167724 Jul 29 05:24:45.694850 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 243/455] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:45 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:24:45.778531 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-7b383cde-03a6-40a6-838e-18e46c33a47f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:45.779451 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-7b383cde-03a6-40a6-838e-18e46c33a47f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: b11929b6-7818-4cae-be4e-8941c93c6aca] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:45.789763 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7b383cde-03a6-40a6-838e-18e46c33a47f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:45.790380 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7b383cde-03a6-40a6-838e-18e46c33a47f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:45.791710 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7b383cde-03a6-40a6-838e-18e46c33a47f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:45.792471 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7b383cde-03a6-40a6-838e-18e46c33a47f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:45.960702 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-7b383cde-03a6-40a6-838e-18e46c33a47f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:45.974031 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-7b383cde-03a6-40a6-838e-18e46c33a47f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca" status: 200 len: 1679 microversion: 2.1 time: 0.199283 Jul 29 05:24:45.975202 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 213/456] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:45 2022] GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca => generated 1679 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:24:46.453569 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-49bda34b-bbee-4b99-a4e9-b7aea2099acf tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:46.454139 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-49bda34b-bbee-4b99-a4e9-b7aea2099acf tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: dbc57534-e5bb-434a-a446-eb402deff943] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:46.461489 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-49bda34b-bbee-4b99-a4e9-b7aea2099acf tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:46.461934 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-49bda34b-bbee-4b99-a4e9-b7aea2099acf tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:46.462766 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-49bda34b-bbee-4b99-a4e9-b7aea2099acf tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:46.463282 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-49bda34b-bbee-4b99-a4e9-b7aea2099acf tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:46.542674 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-49bda34b-bbee-4b99-a4e9-b7aea2099acf tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:46.550758 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-49bda34b-bbee-4b99-a4e9-b7aea2099acf tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943" status: 200 len: 1265 microversion: 2.1 time: 0.101226 Jul 29 05:24:46.551375 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 244/457] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:46 2022] GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943 => generated 1265 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:24:46.721162 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-ae2f8e19-fd24-4f28-b2da-7f3c17c6ca00 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:46.721709 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-ae2f8e19-fd24-4f28-b2da-7f3c17c6ca00 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:46.729055 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ae2f8e19-fd24-4f28-b2da-7f3c17c6ca00 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:46.729556 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ae2f8e19-fd24-4f28-b2da-7f3c17c6ca00 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:46.730390 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ae2f8e19-fd24-4f28-b2da-7f3c17c6ca00 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:46.730894 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ae2f8e19-fd24-4f28-b2da-7f3c17c6ca00 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:46.900817 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-ae2f8e19-fd24-4f28-b2da-7f3c17c6ca00 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:46.911080 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-ae2f8e19-fd24-4f28-b2da-7f3c17c6ca00 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:46.912648 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-ae2f8e19-fd24-4f28-b2da-7f3c17c6ca00 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:46.913873 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-ae2f8e19-fd24-4f28-b2da-7f3c17c6ca00 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1807 microversion: 2.20 time: 0.197012 Jul 29 05:24:46.914449 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 214/458] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:46 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1807 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:24:47.003285 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-7dceac3d-fee2-4d46-81e7-443189ff2c0d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:47.004376 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-7dceac3d-fee2-4d46-81e7-443189ff2c0d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: b11929b6-7818-4cae-be4e-8941c93c6aca] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:47.015907 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7dceac3d-fee2-4d46-81e7-443189ff2c0d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:47.016666 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7dceac3d-fee2-4d46-81e7-443189ff2c0d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:47.017982 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7dceac3d-fee2-4d46-81e7-443189ff2c0d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:47.018748 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7dceac3d-fee2-4d46-81e7-443189ff2c0d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:47.205678 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-7dceac3d-fee2-4d46-81e7-443189ff2c0d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:47.216383 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-7dceac3d-fee2-4d46-81e7-443189ff2c0d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca" status: 200 len: 1679 microversion: 2.1 time: 0.220198 Jul 29 05:24:47.217136 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 245/459] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:46 2022] GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca => generated 1679 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:47.572287 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-d96712e5-f463-4280-a427-77cac222414d tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:47.572861 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-d96712e5-f463-4280-a427-77cac222414d tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: dbc57534-e5bb-434a-a446-eb402deff943] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:47.579898 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d96712e5-f463-4280-a427-77cac222414d tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:47.580390 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d96712e5-f463-4280-a427-77cac222414d tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:47.581214 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d96712e5-f463-4280-a427-77cac222414d tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:47.581687 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d96712e5-f463-4280-a427-77cac222414d tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:47.621476 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 05:24:47.621783 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Fri Jul 29 05:24:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943 (ip 10.222.0.49) !!! Jul 29 05:24:47.663871 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-d96712e5-f463-4280-a427-77cac222414d tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:47.671675 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-d96712e5-f463-4280-a427-77cac222414d tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943" status: 200 len: 1265 microversion: 2.1 time: 0.103464 Jul 29 05:24:47.672262 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 215/460] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:47 2022] GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943 => generated 1265 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:47.943704 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-f1542f40-76ee-4176-a197-41840bd776ee tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:47.946546 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-f1542f40-76ee-4176-a197-41840bd776ee tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:47.955881 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f1542f40-76ee-4176-a197-41840bd776ee tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:47.956433 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f1542f40-76ee-4176-a197-41840bd776ee tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:47.957889 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f1542f40-76ee-4176-a197-41840bd776ee tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:47.958711 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f1542f40-76ee-4176-a197-41840bd776ee tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:48.049134 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-d73bf3c1-4cd3-4eff-9ecc-1bb7f5c3d0a4 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:48.049981 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-d73bf3c1-4cd3-4eff-9ecc-1bb7f5c3d0a4 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:48.060240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d73bf3c1-4cd3-4eff-9ecc-1bb7f5c3d0a4 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:48.060696 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d73bf3c1-4cd3-4eff-9ecc-1bb7f5c3d0a4 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:48.061650 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d73bf3c1-4cd3-4eff-9ecc-1bb7f5c3d0a4 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:48.062210 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d73bf3c1-4cd3-4eff-9ecc-1bb7f5c3d0a4 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:48.173548 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-f1542f40-76ee-4176-a197-41840bd776ee tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:48.183715 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-f1542f40-76ee-4176-a197-41840bd776ee tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:48.185913 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-f1542f40-76ee-4176-a197-41840bd776ee tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:48.187142 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-f1542f40-76ee-4176-a197-41840bd776ee tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1807 microversion: 2.20 time: 0.251775 Jul 29 05:24:48.187751 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 246/461] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:47 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1807 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:24:48.244034 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-8773b943-ce7d-40d0-a447-cf91b774ac6d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:48.245443 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-8773b943-ce7d-40d0-a447-cf91b774ac6d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: b11929b6-7818-4cae-be4e-8941c93c6aca] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:48.257009 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8773b943-ce7d-40d0-a447-cf91b774ac6d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:48.257766 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8773b943-ce7d-40d0-a447-cf91b774ac6d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:48.259116 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8773b943-ce7d-40d0-a447-cf91b774ac6d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:48.260117 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8773b943-ce7d-40d0-a447-cf91b774ac6d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:48.314962 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.objects.instance [None req-d73bf3c1-4cd3-4eff-9ecc-1bb7f5c3d0a4 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lazy-loading 'services' on Instance uuid 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20 {{(pid=117820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:24:48.509525 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-d73bf3c1-4cd3-4eff-9ecc-1bb7f5c3d0a4 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20/os-volume_attachments/c191f2b9-cbb1-4fec-ad49-d8e6a3b44981" status: 202 len: 0 microversion: 2.1 time: 0.468877 Jul 29 05:24:48.510441 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 216/462] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Jul 29 05:24:48 2022] DELETE /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20/os-volume_attachments/c191f2b9-cbb1-4fec-ad49-d8e6a3b44981 => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 05:24:48.525679 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-8773b943-ce7d-40d0-a447-cf91b774ac6d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:48.548652 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-8773b943-ce7d-40d0-a447-cf91b774ac6d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca" status: 200 len: 1679 microversion: 2.1 time: 0.307840 Jul 29 05:24:48.558074 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 247/463] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:48 2022] GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca => generated 1679 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:48.717992 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-bb2ae714-e4f6-4e1a-9823-c50c0d3a65bf tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:48.718666 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-bb2ae714-e4f6-4e1a-9823-c50c0d3a65bf tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: dbc57534-e5bb-434a-a446-eb402deff943] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:48.725739 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bb2ae714-e4f6-4e1a-9823-c50c0d3a65bf tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:48.726290 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bb2ae714-e4f6-4e1a-9823-c50c0d3a65bf tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:48.727110 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bb2ae714-e4f6-4e1a-9823-c50c0d3a65bf tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:48.727600 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bb2ae714-e4f6-4e1a-9823-c50c0d3a65bf tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:48.744527 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:24:48.829915 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-bb2ae714-e4f6-4e1a-9823-c50c0d3a65bf tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:48.842210 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-bb2ae714-e4f6-4e1a-9823-c50c0d3a65bf tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943" status: 200 len: 1271 microversion: 2.1 time: 0.128424 Jul 29 05:24:48.843177 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 217/464] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:48 2022] GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943 => generated 1271 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:49.236893 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-2fadcea5-921c-4a47-bc1e-8010db22d109 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:49.249377 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-2fadcea5-921c-4a47-bc1e-8010db22d109 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:49.284967 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2fadcea5-921c-4a47-bc1e-8010db22d109 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:49.285423 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2fadcea5-921c-4a47-bc1e-8010db22d109 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:49.286391 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2fadcea5-921c-4a47-bc1e-8010db22d109 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:49.286656 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2fadcea5-921c-4a47-bc1e-8010db22d109 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:49.549942 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-2fadcea5-921c-4a47-bc1e-8010db22d109 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:49.563341 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-2fadcea5-921c-4a47-bc1e-8010db22d109 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:49.567289 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-2fadcea5-921c-4a47-bc1e-8010db22d109 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:49.571127 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-2fadcea5-921c-4a47-bc1e-8010db22d109 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1807 microversion: 2.20 time: 0.345606 Jul 29 05:24:49.572955 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 248/465] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:49 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1807 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:24:49.600358 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-108aadd8-629b-492f-8006-912a4d94b4d9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:49.601150 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-108aadd8-629b-492f-8006-912a4d94b4d9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: b11929b6-7818-4cae-be4e-8941c93c6aca] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:49.651256 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-108aadd8-629b-492f-8006-912a4d94b4d9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:49.651679 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-108aadd8-629b-492f-8006-912a4d94b4d9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:49.653320 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-108aadd8-629b-492f-8006-912a4d94b4d9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:49.658898 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-108aadd8-629b-492f-8006-912a4d94b4d9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:49.716317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-e9bb20c7-a253-4432-a08d-824fa8605e33 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:49.717121 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-e9bb20c7-a253-4432-a08d-824fa8605e33 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:49.728582 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e9bb20c7-a253-4432-a08d-824fa8605e33 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:49.729366 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e9bb20c7-a253-4432-a08d-824fa8605e33 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:49.730549 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e9bb20c7-a253-4432-a08d-824fa8605e33 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:49.731304 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e9bb20c7-a253-4432-a08d-824fa8605e33 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:49.766086 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-e9bb20c7-a253-4432-a08d-824fa8605e33 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20] Going to try to terminate instance {{(pid=117821) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 05:24:49.780563 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:24:49.834525 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-108aadd8-629b-492f-8006-912a4d94b4d9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:49.848315 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-108aadd8-629b-492f-8006-912a4d94b4d9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca" status: 200 len: 1613 microversion: 2.1 time: 0.264399 Jul 29 05:24:49.849852 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 218/466] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:49 2022] GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca => generated 1613 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:49.861416 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-e9bb20c7-a253-4432-a08d-824fa8605e33 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20" status: 204 len: 0 microversion: 2.1 time: 0.151178 Jul 29 05:24:49.867279 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 249/467] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 05:24:49 2022] DELETE /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 05:24:49.876851 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-1914931b-897a-4e7d-9a60-2b8f2716b12d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:49.877934 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-a192b336-a97a-42b8-b46b-e92049822e58 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:49.878821 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-a192b336-a97a-42b8-b46b-e92049822e58 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: dbc57534-e5bb-434a-a446-eb402deff943] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:49.887058 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-1914931b-897a-4e7d-9a60-2b8f2716b12d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:49.889645 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a192b336-a97a-42b8-b46b-e92049822e58 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:49.890220 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a192b336-a97a-42b8-b46b-e92049822e58 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:49.891195 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a192b336-a97a-42b8-b46b-e92049822e58 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:49.891753 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a192b336-a97a-42b8-b46b-e92049822e58 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:49.895730 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1914931b-897a-4e7d-9a60-2b8f2716b12d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:49.896342 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1914931b-897a-4e7d-9a60-2b8f2716b12d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:49.897417 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1914931b-897a-4e7d-9a60-2b8f2716b12d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:49.897716 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1914931b-897a-4e7d-9a60-2b8f2716b12d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:50.074315 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-1914931b-897a-4e7d-9a60-2b8f2716b12d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:50.082780 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-1914931b-897a-4e7d-9a60-2b8f2716b12d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20" status: 200 len: 1513 microversion: 2.1 time: 0.210559 Jul 29 05:24:50.083590 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 250/468] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:49 2022] GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20 => generated 1513 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:50.283178 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-c3579243-5c88-43ce-80ee-7eb925e9ec0e req-ca8e7200-51a4-48a0-80f0-a08340ddf1c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b11929b6-7818-4cae-be4e-8941c93c6aca", "name": "network-vif-deleted", "tag": "1d1e98d2-d2a2-495e-8225-fe844a178a63"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:24:50.288474 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-a192b336-a97a-42b8-b46b-e92049822e58 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:50.298831 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-c3579243-5c88-43ce-80ee-7eb925e9ec0e req-ca8e7200-51a4-48a0-80f0-a08340ddf1c9 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:50.300004 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-c3579243-5c88-43ce-80ee-7eb925e9ec0e req-ca8e7200-51a4-48a0-80f0-a08340ddf1c9 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:50.318260 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-a192b336-a97a-42b8-b46b-e92049822e58 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943" status: 200 len: 1313 microversion: 2.1 time: 0.453328 Jul 29 05:24:50.318861 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-c3579243-5c88-43ce-80ee-7eb925e9ec0e req-ca8e7200-51a4-48a0-80f0-a08340ddf1c9 service nova] Creating event network-vif-deleted:1d1e98d2-d2a2-495e-8225-fe844a178a63 for instance b11929b6-7818-4cae-be4e-8941c93c6aca on hv-cinder-85127 Jul 29 05:24:50.323891 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 219/469] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:49 2022] GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943 => generated 1313 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:50.330801 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-c3579243-5c88-43ce-80ee-7eb925e9ec0e req-ca8e7200-51a4-48a0-80f0-a08340ddf1c9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053107 Jul 29 05:24:50.332295 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 251/470] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:24:50.626598 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-50464e0d-cb9f-48e0-9f11-c9c294ff25f2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:50.629737 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-50464e0d-cb9f-48e0-9f11-c9c294ff25f2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:50.642844 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-50464e0d-cb9f-48e0-9f11-c9c294ff25f2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:50.643806 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-50464e0d-cb9f-48e0-9f11-c9c294ff25f2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:50.645188 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-50464e0d-cb9f-48e0-9f11-c9c294ff25f2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:50.645808 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-50464e0d-cb9f-48e0-9f11-c9c294ff25f2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:50.875106 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-f01d39e7-4264-472c-b375-e6ef8ff26eee tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:50.878130 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-f01d39e7-4264-472c-b375-e6ef8ff26eee tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: b11929b6-7818-4cae-be4e-8941c93c6aca] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:50.885793 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f01d39e7-4264-472c-b375-e6ef8ff26eee tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:50.886282 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f01d39e7-4264-472c-b375-e6ef8ff26eee tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:50.888332 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f01d39e7-4264-472c-b375-e6ef8ff26eee tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:50.889512 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f01d39e7-4264-472c-b375-e6ef8ff26eee tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:50.925965 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-50464e0d-cb9f-48e0-9f11-c9c294ff25f2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:50.943465 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-50464e0d-cb9f-48e0-9f11-c9c294ff25f2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:50.949516 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-50464e0d-cb9f-48e0-9f11-c9c294ff25f2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:50.956633 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-50464e0d-cb9f-48e0-9f11-c9c294ff25f2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1807 microversion: 2.20 time: 0.343465 Jul 29 05:24:50.956633 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 220/471] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:50 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1807 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:24:51.031495 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-f01d39e7-4264-472c-b375-e6ef8ff26eee tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:51.045675 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-f01d39e7-4264-472c-b375-e6ef8ff26eee tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca" status: 200 len: 1613 microversion: 2.1 time: 0.174883 Jul 29 05:24:51.046750 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 252/472] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:50 2022] GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca => generated 1613 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:24:51.107185 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-c4b053e0-a1a0-47b4-8133-13a4b900b77d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:51.108034 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-c4b053e0-a1a0-47b4-8133-13a4b900b77d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:51.117793 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c4b053e0-a1a0-47b4-8133-13a4b900b77d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:51.118988 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c4b053e0-a1a0-47b4-8133-13a4b900b77d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:51.120697 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c4b053e0-a1a0-47b4-8133-13a4b900b77d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:51.121484 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c4b053e0-a1a0-47b4-8133-13a4b900b77d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:51.344135 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-c4b053e0-a1a0-47b4-8133-13a4b900b77d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:51.359478 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-7f4f5936-d787-4e51-b667-fc5d9ffd5ed8 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:51.360184 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-7f4f5936-d787-4e51-b667-fc5d9ffd5ed8 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: dbc57534-e5bb-434a-a446-eb402deff943] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:51.374012 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7f4f5936-d787-4e51-b667-fc5d9ffd5ed8 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:51.374485 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7f4f5936-d787-4e51-b667-fc5d9ffd5ed8 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:51.375310 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7f4f5936-d787-4e51-b667-fc5d9ffd5ed8 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:51.375785 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7f4f5936-d787-4e51-b667-fc5d9ffd5ed8 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:51.383486 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-c4b053e0-a1a0-47b4-8133-13a4b900b77d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20" status: 200 len: 1513 microversion: 2.1 time: 0.280895 Jul 29 05:24:51.384069 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 221/473] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:51 2022] GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20 => generated 1513 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:51.625984 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-7f4f5936-d787-4e51-b667-fc5d9ffd5ed8 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:51.643213 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-7f4f5936-d787-4e51-b667-fc5d9ffd5ed8 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943" status: 200 len: 1313 microversion: 2.1 time: 0.287766 Jul 29 05:24:51.643906 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 253/474] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:51 2022] GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943 => generated 1313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:51.984157 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-40f7ba20-75ad-4ef7-b416-d10ab084cff3 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:51.984842 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-40f7ba20-75ad-4ef7-b416-d10ab084cff3 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:51.994711 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-40f7ba20-75ad-4ef7-b416-d10ab084cff3 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:51.995173 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-40f7ba20-75ad-4ef7-b416-d10ab084cff3 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:51.996082 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-40f7ba20-75ad-4ef7-b416-d10ab084cff3 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:51.997322 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-40f7ba20-75ad-4ef7-b416-d10ab084cff3 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:52.080583 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-6740cb20-cf45-4ae9-97e0-47d86188e8bd tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:52.081858 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-6740cb20-cf45-4ae9-97e0-47d86188e8bd tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: b11929b6-7818-4cae-be4e-8941c93c6aca] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:52.090313 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6740cb20-cf45-4ae9-97e0-47d86188e8bd tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:52.091292 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6740cb20-cf45-4ae9-97e0-47d86188e8bd tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:52.092435 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6740cb20-cf45-4ae9-97e0-47d86188e8bd tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:52.093022 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6740cb20-cf45-4ae9-97e0-47d86188e8bd tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:52.207882 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6740cb20-cf45-4ae9-97e0-47d86188e8bd tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:52.209474 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6740cb20-cf45-4ae9-97e0-47d86188e8bd tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:52.211853 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.objects.instance [None req-6740cb20-cf45-4ae9-97e0-47d86188e8bd tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lazy-loading 'fault' on Instance uuid b11929b6-7818-4cae-be4e-8941c93c6aca {{(pid=117821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:24:52.293968 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-6740cb20-cf45-4ae9-97e0-47d86188e8bd tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:52.310626 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-6740cb20-cf45-4ae9-97e0-47d86188e8bd tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca" status: 200 len: 1331 microversion: 2.1 time: 0.234607 Jul 29 05:24:52.312586 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 254/475] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:52 2022] GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca => generated 1331 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:52.369265 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-0575e71a-f1ae-43ad-b897-4c87ef172989 req-ca712a14-cbaa-4608-a07c-3fb4c66f2351 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbc57534-e5bb-434a-a446-eb402deff943", "tag": "7c6f28e6-8fef-44a6-b55e-ca2e7b493160"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:24:52.388494 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-0575e71a-f1ae-43ad-b897-4c87ef172989 req-ca712a14-cbaa-4608-a07c-3fb4c66f2351 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:52.389671 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-0575e71a-f1ae-43ad-b897-4c87ef172989 req-ca712a14-cbaa-4608-a07c-3fb4c66f2351 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:52.412860 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-0575e71a-f1ae-43ad-b897-4c87ef172989 req-ca712a14-cbaa-4608-a07c-3fb4c66f2351 service nova] Creating event network-changed:7c6f28e6-8fef-44a6-b55e-ca2e7b493160 for instance dbc57534-e5bb-434a-a446-eb402deff943 on hv-cinder-85127 Jul 29 05:24:52.422453 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-0575e71a-f1ae-43ad-b897-4c87ef172989 req-ca712a14-cbaa-4608-a07c-3fb4c66f2351 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065723 Jul 29 05:24:52.424331 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 255/476] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:24:52.435069 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-f90b9bb1-68f1-43fc-af65-7bb27a3874a9 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:52.436674 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-f90b9bb1-68f1-43fc-af65-7bb27a3874a9 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:52.451019 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f90b9bb1-68f1-43fc-af65-7bb27a3874a9 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:52.451850 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f90b9bb1-68f1-43fc-af65-7bb27a3874a9 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:52.452193 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-40f7ba20-75ad-4ef7-b416-d10ab084cff3 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:52.453309 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f90b9bb1-68f1-43fc-af65-7bb27a3874a9 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:52.454619 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f90b9bb1-68f1-43fc-af65-7bb27a3874a9 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:52.471645 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-40f7ba20-75ad-4ef7-b416-d10ab084cff3 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:52.473928 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-40f7ba20-75ad-4ef7-b416-d10ab084cff3 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:52.476963 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-40f7ba20-75ad-4ef7-b416-d10ab084cff3 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1807 microversion: 2.20 time: 0.496008 Jul 29 05:24:52.478654 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 222/477] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:51 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1807 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:24:52.645374 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-f90b9bb1-68f1-43fc-af65-7bb27a3874a9 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:52.654817 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-f90b9bb1-68f1-43fc-af65-7bb27a3874a9 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20" status: 200 len: 1513 microversion: 2.1 time: 0.228425 Jul 29 05:24:52.655648 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 256/478] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:52 2022] GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20 => generated 1513 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:52.675633 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-ba6341e6-e39e-4b1e-8830-85b7098faed9 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:52.676957 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-ba6341e6-e39e-4b1e-8830-85b7098faed9 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: dbc57534-e5bb-434a-a446-eb402deff943] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:52.686362 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ba6341e6-e39e-4b1e-8830-85b7098faed9 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:52.686852 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ba6341e6-e39e-4b1e-8830-85b7098faed9 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:52.687688 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ba6341e6-e39e-4b1e-8830-85b7098faed9 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:52.688130 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ba6341e6-e39e-4b1e-8830-85b7098faed9 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:53.039294 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-ba6341e6-e39e-4b1e-8830-85b7098faed9 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:53.048570 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-ba6341e6-e39e-4b1e-8830-85b7098faed9 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943" status: 200 len: 1313 microversion: 2.1 time: 0.380890 Jul 29 05:24:53.049600 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 223/479] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:52 2022] GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943 => generated 1313 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:53.338330 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-4c111142-20ff-4be6-bbad-883f9b401ace tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:53.339479 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-4c111142-20ff-4be6-bbad-883f9b401ace tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: b11929b6-7818-4cae-be4e-8941c93c6aca] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:53.344889 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:24:53.355320 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4c111142-20ff-4be6-bbad-883f9b401ace tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:53.356310 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4c111142-20ff-4be6-bbad-883f9b401ace tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:53.357734 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4c111142-20ff-4be6-bbad-883f9b401ace tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:53.358520 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4c111142-20ff-4be6-bbad-883f9b401ace tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:53.389523 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.wsgi [None req-4c111142-20ff-4be6-bbad-883f9b401ace tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] HTTP exception thrown: Instance b11929b6-7818-4cae-be4e-8941c93c6aca could not be found. Jul 29 05:24:53.392860 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-4c111142-20ff-4be6-bbad-883f9b401ace tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Request method failure captured: Jul 29 05:24:53.392860 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: request: GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca HTTP/1.1 Jul 29 05:24:53.392860 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept: application/json Jul 29 05:24:53.392860 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept-Encoding: identity Jul 29 05:24:53.392860 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Connection: close Jul 29 05:24:53.392860 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Length: 0 Jul 29 05:24:53.392860 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Type: application/json Jul 29 05:24:53.392860 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Host: 10.222.0.49 Jul 29 05:24:53.392860 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Openstack-System-Scope: None Jul 29 05:24:53.392860 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: User-Agent: python-urllib3/1.26.10 Jul 29 05:24:53.392860 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Auth-Token: gAAAAABi425JZwki5zTQDTC3iukDv4VCbNzlxQK73dr9mClVYcp-Pvpl82CYunlqvLixJfXv6lMCmXCQFs-hx71b40CIPEvZNAkIclM8nEjPEEMC1q8Qnidc9zW9MB-6S0Nkj4s67ZnGkNw0VjcX1sLTyzzsa2KGY_dj5NlUwZaoPl1fActyKvM Jul 29 05:24:53.392860 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Id: None Jul 29 05:24:53.392860 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Name: None Jul 29 05:24:53.392860 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Identity-Status: Confirmed Jul 29 05:24:53.392860 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Is-Admin-Project: True Jul 29 05:24:53.392860 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Id: default Jul 29 05:24:53.392860 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Name: Default Jul 29 05:24:53.392860 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Id: 9d8baaf2e23546ee8ed1de278617c7d2 Jul 29 05:24:53.392860 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Name: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:24:53.392860 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Role: member,reader Jul 29 05:24:53.392860 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Roles: member,reader Jul 29 05:24:53.395779 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:24:53.395779 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:24:53.395779 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Id: 9d8baaf2e23546ee8ed1de278617c7d2 Jul 29 05:24:53.395779 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:24:53.395779 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User: tempest-AttachVolumeNegativeTest-480684510-project Jul 29 05:24:53.395779 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Id: default Jul 29 05:24:53.395779 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Name: Default Jul 29 05:24:53.395779 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Id: 3c60b3a983f14f50b1b762a3954a1059 Jul 29 05:24:53.395779 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Name: tempest-AttachVolumeNegativeTest-480684510-project Jul 29 05:24:53.395779 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: method: > Jul 29 05:24:53.395779 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: exception: Instance b11929b6-7818-4cae-be4e-8941c93c6aca could not be found. Jul 29 05:24:53.395779 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: action_args: {'id': 'b11929b6-7818-4cae-be4e-8941c93c6aca'} Jul 29 05:24:53.398798 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:24:53.398798 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:24:53.398798 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:24:53.398798 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:24:53.398798 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:24:53.398798 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:24:53.398798 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:24:53.398798 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:24:53.398798 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:24:53.398798 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:24:53.398798 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b11929b6-7818-4cae-be4e-8941c93c6aca could not be found. Jul 29 05:24:53.398798 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:24:53.398798 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:24:53.398798 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:24:53.398798 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:24:53.398798 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:24:53.398798 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:24:53.398798 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:24:53.398798 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:24:53.398798 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:24:53.401287 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:24:53.401287 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:24:53.401287 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:24:53.401287 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:24:53.401287 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:24:53.401287 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:24:53.401287 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:24:53.401287 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b11929b6-7818-4cae-be4e-8941c93c6aca could not be found. Jul 29 05:24:53.401287 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:24:53.401287 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:24:53.401287 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:24:53.401287 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:24:53.401287 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:24:53.401287 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:24:53.401287 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:24:53.401287 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:24:53.401287 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b11929b6-7818-4cae-be4e-8941c93c6aca could not be found. Jul 29 05:24:53.401287 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:24:53.404628 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-4c111142-20ff-4be6-bbad-883f9b401ace tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Returning 404 to user: Instance b11929b6-7818-4cae-be4e-8941c93c6aca could not be found. {{(pid=117821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:24:53.404628 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-4c111142-20ff-4be6-bbad-883f9b401ace tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca" status: 404 len: 111 microversion: 2.1 time: 0.064282 Jul 29 05:24:53.404628 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 257/480] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:53 2022] GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:24:53.410213 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-90b28968-1b6a-48d3-a97f-e6708927bee5 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '.version_select at 0x7fa63ad5eb80>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:53.451419 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-90b28968-1b6a-48d3-a97f-e6708927bee5 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-685329303" status: 202 len: 0 microversion: 2.1 time: 0.046722 Jul 29 05:24:53.452833 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 224/481] 10.222.0.49 () {58 vars in 1218 bytes} [Fri Jul 29 05:24:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-685329303 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 29 05:24:53.509851 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-70d0d508-5961-44d1-aaf8-e29b0cea51f5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:53.510929 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-70d0d508-5961-44d1-aaf8-e29b0cea51f5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:53.520849 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-70d0d508-5961-44d1-aaf8-e29b0cea51f5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:53.521468 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-70d0d508-5961-44d1-aaf8-e29b0cea51f5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:53.523676 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-70d0d508-5961-44d1-aaf8-e29b0cea51f5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:53.524481 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-70d0d508-5961-44d1-aaf8-e29b0cea51f5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:53.696064 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-bafe9689-0106-4263-8526-ea36cf00cfb5 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:53.697175 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-bafe9689-0106-4263-8526-ea36cf00cfb5 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:53.711176 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bafe9689-0106-4263-8526-ea36cf00cfb5 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:53.712062 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bafe9689-0106-4263-8526-ea36cf00cfb5 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:53.713491 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bafe9689-0106-4263-8526-ea36cf00cfb5 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:53.714296 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bafe9689-0106-4263-8526-ea36cf00cfb5 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:53.763977 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-70d0d508-5961-44d1-aaf8-e29b0cea51f5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:53.775222 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-70d0d508-5961-44d1-aaf8-e29b0cea51f5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:53.777405 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-70d0d508-5961-44d1-aaf8-e29b0cea51f5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:53.784010 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bafe9689-0106-4263-8526-ea36cf00cfb5 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:53.784577 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bafe9689-0106-4263-8526-ea36cf00cfb5 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:53.785397 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.objects.instance [None req-bafe9689-0106-4263-8526-ea36cf00cfb5 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lazy-loading 'fault' on Instance uuid 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20 {{(pid=117820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:24:53.787620 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-70d0d508-5961-44d1-aaf8-e29b0cea51f5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1807 microversion: 2.20 time: 0.277529 Jul 29 05:24:53.789197 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 258/482] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:53 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1807 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:24:53.870864 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-bafe9689-0106-4263-8526-ea36cf00cfb5 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:53.885333 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-bafe9689-0106-4263-8526-ea36cf00cfb5 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20" status: 200 len: 1309 microversion: 2.1 time: 0.196784 Jul 29 05:24:53.886375 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 225/483] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:53 2022] GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20 => generated 1309 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:54.076704 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-e75a6589-6f0f-41f6-b200-3076817f4e09 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:54.077750 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-e75a6589-6f0f-41f6-b200-3076817f4e09 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: dbc57534-e5bb-434a-a446-eb402deff943] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:54.089731 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e75a6589-6f0f-41f6-b200-3076817f4e09 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:54.090767 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e75a6589-6f0f-41f6-b200-3076817f4e09 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:54.093675 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e75a6589-6f0f-41f6-b200-3076817f4e09 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:54.093675 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e75a6589-6f0f-41f6-b200-3076817f4e09 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:54.454441 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-51c36d3f-a5cc-41c8-b2d2-9bed63ca2b0f req-b5201763-45dc-4071-93ae-c064c61c581f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f803c7a-3603-4d3c-bdcf-67e7f12f1b20", "name": "network-vif-deleted", "tag": "7b9f65ae-322a-484b-a4c5-136721870e39"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:24:54.481927 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-51c36d3f-a5cc-41c8-b2d2-9bed63ca2b0f req-b5201763-45dc-4071-93ae-c064c61c581f service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:54.482627 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-51c36d3f-a5cc-41c8-b2d2-9bed63ca2b0f req-b5201763-45dc-4071-93ae-c064c61c581f service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:54.511495 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-51c36d3f-a5cc-41c8-b2d2-9bed63ca2b0f req-b5201763-45dc-4071-93ae-c064c61c581f service nova] Creating event network-vif-deleted:7b9f65ae-322a-484b-a4c5-136721870e39 for instance 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20 on hv-cinder-85127 Jul 29 05:24:54.537991 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-e75a6589-6f0f-41f6-b200-3076817f4e09 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:54.545419 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-51c36d3f-a5cc-41c8-b2d2-9bed63ca2b0f req-b5201763-45dc-4071-93ae-c064c61c581f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097079 Jul 29 05:24:54.548089 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 226/484] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:24:54.551016 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-e75a6589-6f0f-41f6-b200-3076817f4e09 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943" status: 200 len: 1313 microversion: 2.1 time: 0.482610 Jul 29 05:24:54.560977 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 259/485] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:54 2022] GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943 => generated 1313 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:54.579114 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-9f257e3f-6c27-4af2-a8a9-4a13703c8e2b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:54.580475 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-9f257e3f-6c27-4af2-a8a9-4a13703c8e2b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:54.590923 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9f257e3f-6c27-4af2-a8a9-4a13703c8e2b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:54.591521 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9f257e3f-6c27-4af2-a8a9-4a13703c8e2b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:54.592391 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9f257e3f-6c27-4af2-a8a9-4a13703c8e2b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:54.592900 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9f257e3f-6c27-4af2-a8a9-4a13703c8e2b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:54.688187 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.objects.instance [None req-9f257e3f-6c27-4af2-a8a9-4a13703c8e2b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lazy-loading 'services' on Instance uuid 05c46947-e368-441d-9e07-584e95d55780 {{(pid=117820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:24:54.776469 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-9f257e3f-6c27-4af2-a8a9-4a13703c8e2b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "DELETE /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780/os-volume_attachments/45636d85-9505-4a58-808a-cc8312d325b5" status: 202 len: 0 microversion: 2.1 time: 0.216327 Jul 29 05:24:54.777240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 227/486] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Jul 29 05:24:54 2022] DELETE /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780/os-volume_attachments/45636d85-9505-4a58-808a-cc8312d325b5 => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 05:24:54.786601 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-93817eee-fa7d-4557-94ff-6514418654b0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:54.789734 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-93817eee-fa7d-4557-94ff-6514418654b0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:54.796507 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-93817eee-fa7d-4557-94ff-6514418654b0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:54.796954 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-93817eee-fa7d-4557-94ff-6514418654b0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:54.797743 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-93817eee-fa7d-4557-94ff-6514418654b0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:54.798182 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-93817eee-fa7d-4557-94ff-6514418654b0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:54.813585 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-462081eb-37c6-461e-a89e-4925c6497d0b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:54.814285 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-462081eb-37c6-461e-a89e-4925c6497d0b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:54.821437 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-462081eb-37c6-461e-a89e-4925c6497d0b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:54.821888 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-462081eb-37c6-461e-a89e-4925c6497d0b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:54.822759 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-462081eb-37c6-461e-a89e-4925c6497d0b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:54.823230 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-462081eb-37c6-461e-a89e-4925c6497d0b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:54.835327 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-93817eee-fa7d-4557-94ff-6514418654b0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052636 Jul 29 05:24:54.836020 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 260/487] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:24:54 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:24:54.926322 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-ffa18f39-1db3-4c2e-a296-4883a814969b tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:54.930256 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-ffa18f39-1db3-4c2e-a296-4883a814969b tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:54.946958 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ffa18f39-1db3-4c2e-a296-4883a814969b tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:54.947678 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ffa18f39-1db3-4c2e-a296-4883a814969b tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:54.948782 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ffa18f39-1db3-4c2e-a296-4883a814969b tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:54.950530 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ffa18f39-1db3-4c2e-a296-4883a814969b tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:55.032176 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ffa18f39-1db3-4c2e-a296-4883a814969b tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:55.034158 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ffa18f39-1db3-4c2e-a296-4883a814969b tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:55.035589 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.objects.instance [None req-ffa18f39-1db3-4c2e-a296-4883a814969b tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lazy-loading 'fault' on Instance uuid 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20 {{(pid=117821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:24:55.114850 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-ffa18f39-1db3-4c2e-a296-4883a814969b tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:55.124094 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-ffa18f39-1db3-4c2e-a296-4883a814969b tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20" status: 200 len: 1309 microversion: 2.1 time: 0.215199 Jul 29 05:24:55.125091 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 261/488] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:54 2022] GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20 => generated 1309 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:55.180952 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-462081eb-37c6-461e-a89e-4925c6497d0b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:55.192258 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-462081eb-37c6-461e-a89e-4925c6497d0b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:55.194387 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-462081eb-37c6-461e-a89e-4925c6497d0b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:55.196279 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-462081eb-37c6-461e-a89e-4925c6497d0b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1807 microversion: 2.20 time: 0.386867 Jul 29 05:24:55.197173 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 228/489] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:54 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1807 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:24:55.583040 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-df3661ba-045e-4824-9f23-db030ae4af06 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:55.585455 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-df3661ba-045e-4824-9f23-db030ae4af06 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: dbc57534-e5bb-434a-a446-eb402deff943] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:55.598862 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-df3661ba-045e-4824-9f23-db030ae4af06 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:55.599741 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-df3661ba-045e-4824-9f23-db030ae4af06 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:55.601389 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-df3661ba-045e-4824-9f23-db030ae4af06 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:55.602648 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-df3661ba-045e-4824-9f23-db030ae4af06 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:55.802317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-df3661ba-045e-4824-9f23-db030ae4af06 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:55.818398 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-df3661ba-045e-4824-9f23-db030ae4af06 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943" status: 200 len: 1313 microversion: 2.1 time: 0.242889 Jul 29 05:24:55.819759 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 262/490] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:55 2022] GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943 => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:55.855416 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-17f1c35b-f3ed-4ba4-89a4-1cd144a9d638 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:55.859424 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-17f1c35b-f3ed-4ba4-89a4-1cd144a9d638 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:55.869569 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-17f1c35b-f3ed-4ba4-89a4-1cd144a9d638 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:55.870684 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-17f1c35b-f3ed-4ba4-89a4-1cd144a9d638 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:55.871815 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-17f1c35b-f3ed-4ba4-89a4-1cd144a9d638 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:55.872266 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-17f1c35b-f3ed-4ba4-89a4-1cd144a9d638 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:55.913369 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-17f1c35b-f3ed-4ba4-89a4-1cd144a9d638 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066944 Jul 29 05:24:55.919781 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 229/491] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:24:55 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:24:56.156296 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-a9abde90-421d-4eea-9e52-ab6aac05149a tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:56.157179 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-a9abde90-421d-4eea-9e52-ab6aac05149a tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:56.166046 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a9abde90-421d-4eea-9e52-ab6aac05149a tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:56.166857 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a9abde90-421d-4eea-9e52-ab6aac05149a tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:56.168307 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a9abde90-421d-4eea-9e52-ab6aac05149a tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:56.169110 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a9abde90-421d-4eea-9e52-ab6aac05149a tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:56.191919 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.wsgi [None req-a9abde90-421d-4eea-9e52-ab6aac05149a tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] HTTP exception thrown: Instance 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20 could not be found. Jul 29 05:24:56.193636 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-a9abde90-421d-4eea-9e52-ab6aac05149a tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Request method failure captured: Jul 29 05:24:56.193636 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: request: GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20 HTTP/1.1 Jul 29 05:24:56.193636 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept: application/json Jul 29 05:24:56.193636 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept-Encoding: identity Jul 29 05:24:56.193636 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Connection: close Jul 29 05:24:56.193636 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Length: 0 Jul 29 05:24:56.193636 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Type: application/json Jul 29 05:24:56.193636 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Host: 10.222.0.49 Jul 29 05:24:56.193636 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Openstack-System-Scope: None Jul 29 05:24:56.193636 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: User-Agent: python-urllib3/1.26.10 Jul 29 05:24:56.193636 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Auth-Token: gAAAAABi427RMdBC2S3Jkyx5DLQwh1PBNabeRRWII7P3s8i88GhoFUIdU_MERfLomcJ6mznfnqUe1GmYSLxTu38GUYObXwx2ipgkHkev8EwoSrzsUA2liWP5lPk1oKHkLoog9dZ4lwPLEcDRCFT2kEKSXSDrf-TB6A0JHTcmtF0LozWefwYNZz8 Jul 29 05:24:56.193636 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Id: None Jul 29 05:24:56.193636 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Name: None Jul 29 05:24:56.193636 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Identity-Status: Confirmed Jul 29 05:24:56.193636 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Is-Admin-Project: True Jul 29 05:24:56.193636 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Id: default Jul 29 05:24:56.193636 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Name: Default Jul 29 05:24:56.193636 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Id: 1f75331a524c4a5a981dfd1fdc361467 Jul 29 05:24:56.193636 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2043845827 Jul 29 05:24:56.193636 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Role: member,reader Jul 29 05:24:56.193636 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Roles: member,reader Jul 29 05:24:56.195313 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1f75331a524c4a5a981dfd1fdc361467"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1f75331a524c4a5a981dfd1fdc361467"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1f75331a524c4a5a981dfd1fdc361467"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1f75331a524c4a5a981dfd1fdc361467"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:24:56.195313 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant: tempest-VolumesSnapshotTestJSON-2043845827 Jul 29 05:24:56.195313 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Id: 1f75331a524c4a5a981dfd1fdc361467 Jul 29 05:24:56.195313 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2043845827 Jul 29 05:24:56.195313 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User: tempest-VolumesSnapshotTestJSON-2043845827-project Jul 29 05:24:56.195313 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Id: default Jul 29 05:24:56.195313 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Name: Default Jul 29 05:24:56.195313 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Id: 1690be2d7032472391fa96e23e0c1bf0 Jul 29 05:24:56.195313 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Name: tempest-VolumesSnapshotTestJSON-2043845827-project Jul 29 05:24:56.195313 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: method: > Jul 29 05:24:56.195313 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: exception: Instance 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20 could not be found. Jul 29 05:24:56.195313 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: action_args: {'id': '9f803c7a-3603-4d3c-bdcf-67e7f12f1b20'} Jul 29 05:24:56.196617 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:24:56.196617 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:24:56.196617 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:24:56.196617 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:24:56.196617 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:24:56.196617 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:24:56.196617 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:24:56.196617 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:24:56.196617 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:24:56.196617 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:24:56.196617 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20 could not be found. Jul 29 05:24:56.196617 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:24:56.196617 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:24:56.196617 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:24:56.196617 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:24:56.196617 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:24:56.196617 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:24:56.196617 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:24:56.196617 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:24:56.196617 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:24:56.200637 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:24:56.200637 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:24:56.200637 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:24:56.200637 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:24:56.200637 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:24:56.200637 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:24:56.200637 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:24:56.200637 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20 could not be found. Jul 29 05:24:56.200637 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:24:56.200637 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:24:56.200637 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:24:56.200637 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:24:56.200637 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:24:56.200637 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:24:56.200637 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:24:56.200637 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:24:56.200637 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20 could not be found. Jul 29 05:24:56.200637 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:24:56.202323 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-a9abde90-421d-4eea-9e52-ab6aac05149a tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Returning 404 to user: Instance 9f803c7a-3603-4d3c-bdcf-67e7f12f1b20 could not be found. {{(pid=117821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:24:56.202323 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-a9abde90-421d-4eea-9e52-ab6aac05149a tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20" status: 404 len: 111 microversion: 2.1 time: 0.043326 Jul 29 05:24:56.202323 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 263/492] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:56 2022] GET /compute/v2.1/servers/9f803c7a-3603-4d3c-bdcf-67e7f12f1b20 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:24:56.223971 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-ee5aa838-faac-4d55-b337-077cf7994b31 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:56.224452 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-ee5aa838-faac-4d55-b337-077cf7994b31 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:56.233343 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ee5aa838-faac-4d55-b337-077cf7994b31 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:56.233793 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ee5aa838-faac-4d55-b337-077cf7994b31 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:56.235505 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ee5aa838-faac-4d55-b337-077cf7994b31 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:56.235505 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ee5aa838-faac-4d55-b337-077cf7994b31 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:56.444141 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-ee5aa838-faac-4d55-b337-077cf7994b31 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:56.469675 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-ee5aa838-faac-4d55-b337-077cf7994b31 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:56.473336 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-ee5aa838-faac-4d55-b337-077cf7994b31 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:56.476096 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-ee5aa838-faac-4d55-b337-077cf7994b31 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1807 microversion: 2.20 time: 0.257452 Jul 29 05:24:56.477212 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 230/493] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:56 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1807 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:24:56.745651 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-856a6114-9053-4153-b929-a3a0e0de2276 req-683eba24-82fe-4a0e-a301-b60b81373e61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ff4221e-eadc-491b-9f3c-9b41413a63d0", "name": "network-vif-plugged", "status": "completed", "tag": "de35419f-6c42-424f-baf0-e88731e69e60"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:24:56.766328 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-856a6114-9053-4153-b929-a3a0e0de2276 req-683eba24-82fe-4a0e-a301-b60b81373e61 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:56.767122 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-856a6114-9053-4153-b929-a3a0e0de2276 req-683eba24-82fe-4a0e-a301-b60b81373e61 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:56.791599 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-856a6114-9053-4153-b929-a3a0e0de2276 req-683eba24-82fe-4a0e-a301-b60b81373e61 service nova] Creating event network-vif-plugged:de35419f-6c42-424f-baf0-e88731e69e60 for instance 6ff4221e-eadc-491b-9f3c-9b41413a63d0 on hv-cinder-85127 Jul 29 05:24:56.801120 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-856a6114-9053-4153-b929-a3a0e0de2276 req-683eba24-82fe-4a0e-a301-b60b81373e61 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061264 Jul 29 05:24:56.802175 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 264/494] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:24:56.853008 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-37f95732-c47c-4545-b97b-3166da3592bb tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:56.853636 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-37f95732-c47c-4545-b97b-3166da3592bb tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: dbc57534-e5bb-434a-a446-eb402deff943] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:56.862873 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-37f95732-c47c-4545-b97b-3166da3592bb tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:56.863934 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-37f95732-c47c-4545-b97b-3166da3592bb tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:56.866276 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-37f95732-c47c-4545-b97b-3166da3592bb tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:56.867262 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-37f95732-c47c-4545-b97b-3166da3592bb tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:56.932859 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-3061267f-c610-4502-8759-0d631c6944a3 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:56.948660 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-3061267f-c610-4502-8759-0d631c6944a3 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:56.962311 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3061267f-c610-4502-8759-0d631c6944a3 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:56.963142 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3061267f-c610-4502-8759-0d631c6944a3 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:56.964676 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3061267f-c610-4502-8759-0d631c6944a3 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:56.965483 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3061267f-c610-4502-8759-0d631c6944a3 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:57.025493 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-3061267f-c610-4502-8759-0d631c6944a3 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.101090 Jul 29 05:24:57.026070 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 265/495] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:24:56 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780/os-volume_attachments => generated 25 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 29 05:24:57.057516 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-37f95732-c47c-4545-b97b-3166da3592bb tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:57.065744 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-37f95732-c47c-4545-b97b-3166da3592bb tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943" status: 200 len: 1313 microversion: 2.1 time: 0.217654 Jul 29 05:24:57.066450 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 231/496] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:56 2022] GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:57.114213 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-030a00a1-78da-4e64-a37e-8da1b1764ea1 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:57.114756 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-030a00a1-78da-4e64-a37e-8da1b1764ea1 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:57.122788 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-030a00a1-78da-4e64-a37e-8da1b1764ea1 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:57.123405 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-030a00a1-78da-4e64-a37e-8da1b1764ea1 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:57.124247 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-030a00a1-78da-4e64-a37e-8da1b1764ea1 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:57.124726 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-030a00a1-78da-4e64-a37e-8da1b1764ea1 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:57.154418 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-030a00a1-78da-4e64-a37e-8da1b1764ea1 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Going to try to terminate instance {{(pid=117821) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 05:24:57.194186 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:24:57.251797 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-030a00a1-78da-4e64-a37e-8da1b1764ea1 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "DELETE /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780" status: 204 len: 0 microversion: 2.1 time: 0.141318 Jul 29 05:24:57.252599 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 266/497] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 05:24:57 2022] DELETE /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 05:24:57.266404 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-e50ac0db-d672-41ef-8b8b-5f80a0bf310d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:57.267564 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-e50ac0db-d672-41ef-8b8b-5f80a0bf310d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:57.279198 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e50ac0db-d672-41ef-8b8b-5f80a0bf310d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:57.280086 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e50ac0db-d672-41ef-8b8b-5f80a0bf310d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:57.281500 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e50ac0db-d672-41ef-8b8b-5f80a0bf310d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:57.282555 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e50ac0db-d672-41ef-8b8b-5f80a0bf310d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:57.462021 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-e50ac0db-d672-41ef-8b8b-5f80a0bf310d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:57.470593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-e50ac0db-d672-41ef-8b8b-5f80a0bf310d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780" status: 200 len: 1679 microversion: 2.1 time: 0.211191 Jul 29 05:24:57.471295 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 232/498] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:57 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 => generated 1679 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:57.504484 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-bed001b4-6a5b-41ba-9d23-65b9e2992da8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:57.505828 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-bed001b4-6a5b-41ba-9d23-65b9e2992da8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:57.514214 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bed001b4-6a5b-41ba-9d23-65b9e2992da8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:57.514660 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bed001b4-6a5b-41ba-9d23-65b9e2992da8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:57.515488 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bed001b4-6a5b-41ba-9d23-65b9e2992da8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:57.515932 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bed001b4-6a5b-41ba-9d23-65b9e2992da8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:57.662653 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-bed001b4-6a5b-41ba-9d23-65b9e2992da8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:57.672715 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-bed001b4-6a5b-41ba-9d23-65b9e2992da8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:57.674261 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-bed001b4-6a5b-41ba-9d23-65b9e2992da8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:57.675548 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-bed001b4-6a5b-41ba-9d23-65b9e2992da8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1807 microversion: 2.20 time: 0.177350 Jul 29 05:24:57.676268 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 267/499] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:57 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:24:58.103017 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-6a34c34c-b627-4cb2-93c2-cd45323f94f5 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:58.103670 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-6a34c34c-b627-4cb2-93c2-cd45323f94f5 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: dbc57534-e5bb-434a-a446-eb402deff943] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:58.111461 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6a34c34c-b627-4cb2-93c2-cd45323f94f5 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:58.111915 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6a34c34c-b627-4cb2-93c2-cd45323f94f5 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:58.112723 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6a34c34c-b627-4cb2-93c2-cd45323f94f5 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:58.113164 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6a34c34c-b627-4cb2-93c2-cd45323f94f5 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:58.260730 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-6a34c34c-b627-4cb2-93c2-cd45323f94f5 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:58.271112 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-6a34c34c-b627-4cb2-93c2-cd45323f94f5 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943" status: 200 len: 1313 microversion: 2.1 time: 0.173015 Jul 29 05:24:58.272800 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 233/500] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:58 2022] GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:24:58.508175 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-ddad5bcd-e2d4-4a82-905e-14278e50a9e9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:58.508817 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-ddad5bcd-e2d4-4a82-905e-14278e50a9e9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:58.516243 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ddad5bcd-e2d4-4a82-905e-14278e50a9e9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:58.516823 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ddad5bcd-e2d4-4a82-905e-14278e50a9e9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:58.517601 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ddad5bcd-e2d4-4a82-905e-14278e50a9e9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:58.518039 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ddad5bcd-e2d4-4a82-905e-14278e50a9e9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:58.669827 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-ddad5bcd-e2d4-4a82-905e-14278e50a9e9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:58.677745 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-ddad5bcd-e2d4-4a82-905e-14278e50a9e9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780" status: 200 len: 1679 microversion: 2.1 time: 0.174220 Jul 29 05:24:58.679159 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 268/501] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:58 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:58.714021 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-0b654388-0ac7-424e-ba8d-25be5b824a16 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:58.714771 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-0b654388-0ac7-424e-ba8d-25be5b824a16 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:58.721420 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0b654388-0ac7-424e-ba8d-25be5b824a16 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:58.721894 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0b654388-0ac7-424e-ba8d-25be5b824a16 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:58.722727 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0b654388-0ac7-424e-ba8d-25be5b824a16 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:58.723114 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0b654388-0ac7-424e-ba8d-25be5b824a16 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:58.874702 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-0b654388-0ac7-424e-ba8d-25be5b824a16 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:58.879079 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:24:58.889984 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-0b654388-0ac7-424e-ba8d-25be5b824a16 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:58.891706 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-0b654388-0ac7-424e-ba8d-25be5b824a16 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:58.892993 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-0b654388-0ac7-424e-ba8d-25be5b824a16 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1807 microversion: 2.20 time: 0.182931 Jul 29 05:24:58.893594 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 234/502] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:58 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:24:59.299002 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-4057a99f-659d-4bcb-b18c-2c67fbe01204 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:59.300186 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-4057a99f-659d-4bcb-b18c-2c67fbe01204 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: dbc57534-e5bb-434a-a446-eb402deff943] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:59.311435 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4057a99f-659d-4bcb-b18c-2c67fbe01204 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:59.312005 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4057a99f-659d-4bcb-b18c-2c67fbe01204 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:59.313362 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4057a99f-659d-4bcb-b18c-2c67fbe01204 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:59.314173 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4057a99f-659d-4bcb-b18c-2c67fbe01204 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:59.493786 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-4057a99f-659d-4bcb-b18c-2c67fbe01204 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:59.502484 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-4057a99f-659d-4bcb-b18c-2c67fbe01204 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943" status: 200 len: 1313 microversion: 2.1 time: 0.210927 Jul 29 05:24:59.503278 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 269/503] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:59 2022] GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:59.658441 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-0a45d914-cdb3-4331-a56b-ef332d51a3eb tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:59.660406 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-0a45d914-cdb3-4331-a56b-ef332d51a3eb tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:59.674170 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0a45d914-cdb3-4331-a56b-ef332d51a3eb tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:59.674938 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0a45d914-cdb3-4331-a56b-ef332d51a3eb tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:59.676379 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0a45d914-cdb3-4331-a56b-ef332d51a3eb tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:59.677169 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0a45d914-cdb3-4331-a56b-ef332d51a3eb tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:59.708272 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-c646e698-44c2-4876-8373-a947b3d9dfb4 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:59.709675 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-c646e698-44c2-4876-8373-a947b3d9dfb4 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:59.718747 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c646e698-44c2-4876-8373-a947b3d9dfb4 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:59.719415 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c646e698-44c2-4876-8373-a947b3d9dfb4 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:59.720306 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c646e698-44c2-4876-8373-a947b3d9dfb4 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:59.721075 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c646e698-44c2-4876-8373-a947b3d9dfb4 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:59.786422 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.objects.instance [None req-0a45d914-cdb3-4331-a56b-ef332d51a3eb tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lazy-loading 'services' on Instance uuid f6ff83e9-b98e-47c5-83cb-37ac61826fba {{(pid=117820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:24:59.887198 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-0a45d914-cdb3-4331-a56b-ef332d51a3eb tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba/os-volume_attachments/c05e2031-ada4-4f0b-99b6-0386d27b81ff" status: 202 len: 0 microversion: 2.1 time: 0.235485 Jul 29 05:24:59.887918 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 235/504] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Jul 29 05:24:59 2022] DELETE /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba/os-volume_attachments/c05e2031-ada4-4f0b-99b6-0386d27b81ff => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 05:24:59.888592 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-c646e698-44c2-4876-8373-a947b3d9dfb4 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:24:59.898208 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-c646e698-44c2-4876-8373-a947b3d9dfb4 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780" status: 200 len: 1679 microversion: 2.1 time: 0.193980 Jul 29 05:24:59.898840 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 270/505] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:24:59 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 => generated 1679 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:24:59.933788 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-0d510f00-9ef4-4541-a600-7c65bc5a74db tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:24:59.934621 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-0d510f00-9ef4-4541-a600-7c65bc5a74db tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:24:59.942219 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0d510f00-9ef4-4541-a600-7c65bc5a74db tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:59.942685 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0d510f00-9ef4-4541-a600-7c65bc5a74db tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:24:59.944546 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0d510f00-9ef4-4541-a600-7c65bc5a74db tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:24:59.945004 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0d510f00-9ef4-4541-a600-7c65bc5a74db tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:00.102079 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-0d510f00-9ef4-4541-a600-7c65bc5a74db tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:00.111337 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-0d510f00-9ef4-4541-a600-7c65bc5a74db tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:00.113033 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-0d510f00-9ef4-4541-a600-7c65bc5a74db tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:00.114373 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-0d510f00-9ef4-4541-a600-7c65bc5a74db tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1807 microversion: 2.20 time: 0.185402 Jul 29 05:25:00.114945 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 236/506] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:24:59 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:25:00.526197 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-8af232c8-dae5-4ae0-8d17-8b7ced92b5c2 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:00.526815 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-8af232c8-dae5-4ae0-8d17-8b7ced92b5c2 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: dbc57534-e5bb-434a-a446-eb402deff943] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:00.533424 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8af232c8-dae5-4ae0-8d17-8b7ced92b5c2 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:00.533876 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8af232c8-dae5-4ae0-8d17-8b7ced92b5c2 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:00.534698 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8af232c8-dae5-4ae0-8d17-8b7ced92b5c2 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:00.535140 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8af232c8-dae5-4ae0-8d17-8b7ced92b5c2 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:00.673638 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-8af232c8-dae5-4ae0-8d17-8b7ced92b5c2 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:00.681656 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-8af232c8-dae5-4ae0-8d17-8b7ced92b5c2 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943" status: 200 len: 1313 microversion: 2.1 time: 0.160200 Jul 29 05:25:00.682254 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 271/507] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:00 2022] GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:00.921637 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-cfe1d8da-63d8-48b7-937e-6272946e4edd tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:00.922382 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-cfe1d8da-63d8-48b7-937e-6272946e4edd tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:00.930082 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-cfe1d8da-63d8-48b7-937e-6272946e4edd tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:00.930543 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-cfe1d8da-63d8-48b7-937e-6272946e4edd tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:00.931330 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-cfe1d8da-63d8-48b7-937e-6272946e4edd tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:00.931806 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-cfe1d8da-63d8-48b7-937e-6272946e4edd tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:01.097210 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-cfe1d8da-63d8-48b7-937e-6272946e4edd tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:01.107482 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-cfe1d8da-63d8-48b7-937e-6272946e4edd tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780" status: 200 len: 1679 microversion: 2.1 time: 0.188598 Jul 29 05:25:01.107482 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 237/508] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:00 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 => generated 1679 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:01.140950 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-60fd4618-0f07-4960-996d-2601ff90c4fd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:01.142187 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-60fd4618-0f07-4960-996d-2601ff90c4fd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:01.149866 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-60fd4618-0f07-4960-996d-2601ff90c4fd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:01.150609 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-60fd4618-0f07-4960-996d-2601ff90c4fd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:01.151375 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-60fd4618-0f07-4960-996d-2601ff90c4fd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:01.151831 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-60fd4618-0f07-4960-996d-2601ff90c4fd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:01.292422 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-60fd4618-0f07-4960-996d-2601ff90c4fd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:01.301442 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-60fd4618-0f07-4960-996d-2601ff90c4fd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:01.305174 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-60fd4618-0f07-4960-996d-2601ff90c4fd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:01.307572 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-60fd4618-0f07-4960-996d-2601ff90c4fd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1807 microversion: 2.20 time: 0.170850 Jul 29 05:25:01.308810 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 272/509] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:25:01 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:25:01.704169 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-75214006-d9b7-4f8b-8812-0e26880b0f04 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:01.704769 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-75214006-d9b7-4f8b-8812-0e26880b0f04 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: dbc57534-e5bb-434a-a446-eb402deff943] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:01.711786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-75214006-d9b7-4f8b-8812-0e26880b0f04 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:01.712239 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-75214006-d9b7-4f8b-8812-0e26880b0f04 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:01.713005 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-75214006-d9b7-4f8b-8812-0e26880b0f04 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:01.713434 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-75214006-d9b7-4f8b-8812-0e26880b0f04 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:01.850211 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-75214006-d9b7-4f8b-8812-0e26880b0f04 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:01.857669 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-75214006-d9b7-4f8b-8812-0e26880b0f04 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943" status: 200 len: 1313 microversion: 2.1 time: 0.157531 Jul 29 05:25:01.858238 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 238/510] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:01 2022] GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:02.130291 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-065d7b0c-a752-4620-8cf8-82ab8db643d0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:02.131068 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-065d7b0c-a752-4620-8cf8-82ab8db643d0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:02.138822 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-065d7b0c-a752-4620-8cf8-82ab8db643d0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:02.139273 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-065d7b0c-a752-4620-8cf8-82ab8db643d0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:02.141097 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-065d7b0c-a752-4620-8cf8-82ab8db643d0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:02.141662 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-065d7b0c-a752-4620-8cf8-82ab8db643d0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:02.303975 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-954da664-1456-42de-aa0c-c02c679a101f req-2082b3de-246e-436c-b9b0-bd590817953c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc57534-e5bb-434a-a446-eb402deff943", "name": "network-vif-plugged", "status": "completed", "tag": "7c6f28e6-8fef-44a6-b55e-ca2e7b493160"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:25:02.316725 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-954da664-1456-42de-aa0c-c02c679a101f req-2082b3de-246e-436c-b9b0-bd590817953c service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:02.317775 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-954da664-1456-42de-aa0c-c02c679a101f req-2082b3de-246e-436c-b9b0-bd590817953c service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:02.337101 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-065d7b0c-a752-4620-8cf8-82ab8db643d0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:02.346395 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-065d7b0c-a752-4620-8cf8-82ab8db643d0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780" status: 200 len: 1679 microversion: 2.1 time: 0.222450 Jul 29 05:25:02.351431 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-954da664-1456-42de-aa0c-c02c679a101f req-2082b3de-246e-436c-b9b0-bd590817953c service nova] Creating event network-vif-plugged:7c6f28e6-8fef-44a6-b55e-ca2e7b493160 for instance dbc57534-e5bb-434a-a446-eb402deff943 on hv-cinder-85127 Jul 29 05:25:02.362425 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 273/511] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:02 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 => generated 1679 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:02.363295 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-954da664-1456-42de-aa0c-c02c679a101f req-2082b3de-246e-436c-b9b0-bd590817953c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063147 Jul 29 05:25:02.364394 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 239/512] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:25:02.368705 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-b5b080fc-9230-4cc6-8bf6-4bef974d2ae2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:02.369737 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-b5b080fc-9230-4cc6-8bf6-4bef974d2ae2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:02.376394 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b5b080fc-9230-4cc6-8bf6-4bef974d2ae2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:02.376844 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b5b080fc-9230-4cc6-8bf6-4bef974d2ae2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:02.377641 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b5b080fc-9230-4cc6-8bf6-4bef974d2ae2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:02.378078 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b5b080fc-9230-4cc6-8bf6-4bef974d2ae2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:02.525973 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-b5b080fc-9230-4cc6-8bf6-4bef974d2ae2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:02.535163 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-b5b080fc-9230-4cc6-8bf6-4bef974d2ae2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:02.536763 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-b5b080fc-9230-4cc6-8bf6-4bef974d2ae2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:02.539306 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-b5b080fc-9230-4cc6-8bf6-4bef974d2ae2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1807 microversion: 2.20 time: 0.175772 Jul 29 05:25:02.539912 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 274/513] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:25:02 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:25:02.883148 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-01d7399c-69c5-4985-9dcf-c17f108ea1d1 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:02.884468 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-01d7399c-69c5-4985-9dcf-c17f108ea1d1 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: dbc57534-e5bb-434a-a446-eb402deff943] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:02.894854 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-01d7399c-69c5-4985-9dcf-c17f108ea1d1 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:02.895311 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-01d7399c-69c5-4985-9dcf-c17f108ea1d1 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:02.896147 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-01d7399c-69c5-4985-9dcf-c17f108ea1d1 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:02.897298 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-01d7399c-69c5-4985-9dcf-c17f108ea1d1 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:03.043188 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-01d7399c-69c5-4985-9dcf-c17f108ea1d1 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:03.050810 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-01d7399c-69c5-4985-9dcf-c17f108ea1d1 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943" status: 200 len: 1313 microversion: 2.1 time: 0.175375 Jul 29 05:25:03.051409 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 240/514] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:02 2022] GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:03.372193 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-5d5d8f72-35d7-4d1a-afc0-1954d8f03a45 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:03.372809 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-5d5d8f72-35d7-4d1a-afc0-1954d8f03a45 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:03.379960 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5d5d8f72-35d7-4d1a-afc0-1954d8f03a45 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:03.380405 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5d5d8f72-35d7-4d1a-afc0-1954d8f03a45 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:03.382507 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5d5d8f72-35d7-4d1a-afc0-1954d8f03a45 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:03.382944 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5d5d8f72-35d7-4d1a-afc0-1954d8f03a45 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:03.526556 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-5d5d8f72-35d7-4d1a-afc0-1954d8f03a45 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:03.535336 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-5d5d8f72-35d7-4d1a-afc0-1954d8f03a45 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780" status: 200 len: 1679 microversion: 2.1 time: 0.167592 Jul 29 05:25:03.535944 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 275/515] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:03 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:03.565741 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-8eebb611-39b4-46a2-89bd-782db91d89e4 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:03.566322 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-8eebb611-39b4-46a2-89bd-782db91d89e4 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:03.573339 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8eebb611-39b4-46a2-89bd-782db91d89e4 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:03.573939 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8eebb611-39b4-46a2-89bd-782db91d89e4 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:03.574864 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8eebb611-39b4-46a2-89bd-782db91d89e4 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:03.575338 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8eebb611-39b4-46a2-89bd-782db91d89e4 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:03.721816 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-8eebb611-39b4-46a2-89bd-782db91d89e4 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:03.732071 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-8eebb611-39b4-46a2-89bd-782db91d89e4 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:03.733705 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-8eebb611-39b4-46a2-89bd-782db91d89e4 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:03.734955 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-8eebb611-39b4-46a2-89bd-782db91d89e4 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1807 microversion: 2.20 time: 0.173125 Jul 29 05:25:03.735578 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 241/516] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:25:03 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:25:04.072790 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-fff19390-eccf-4000-97f5-70e7ae618dad tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:04.073399 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-fff19390-eccf-4000-97f5-70e7ae618dad tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: dbc57534-e5bb-434a-a446-eb402deff943] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:04.079799 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-fff19390-eccf-4000-97f5-70e7ae618dad tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:04.080255 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-fff19390-eccf-4000-97f5-70e7ae618dad tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:04.081038 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-fff19390-eccf-4000-97f5-70e7ae618dad tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:04.081477 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-fff19390-eccf-4000-97f5-70e7ae618dad tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:04.207252 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-6d67e647-d3f9-4778-abef-556bb40ac09f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "596e7484-d6fd-4d29-b72b-02ba35278ef9"}} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:25:04.211737 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-6d67e647-d3f9-4778-abef-556bb40ac09f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:04.219824 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6d67e647-d3f9-4778-abef-556bb40ac09f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:04.220280 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6d67e647-d3f9-4778-abef-556bb40ac09f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:04.221379 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6d67e647-d3f9-4778-abef-556bb40ac09f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:04.222434 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6d67e647-d3f9-4778-abef-556bb40ac09f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:04.269999 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-fff19390-eccf-4000-97f5-70e7ae618dad tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:04.287179 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-fff19390-eccf-4000-97f5-70e7ae618dad tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943" status: 200 len: 1313 microversion: 2.1 time: 0.218524 Jul 29 05:25:04.290337 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 276/517] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:04 2022] GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:25:04.372676 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-cced0c75-c72d-4e1e-9cb3-d0265522ac5f tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1850887306", "imageRef": "b7bf870d-4e7c-42fd-849f-72ac19277493", "flavorRef": "452", "networks": [{"uuid": "6068f512-e267-445c-a8db-5edcf9da6f4b"}]}} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:25:04.447956 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.network.neutron [None req-cced0c75-c72d-4e1e-9cb3-d0265522ac5f tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] validate_networks() for [('6068f512-e267-445c-a8db-5edcf9da6f4b', None, None, None, None, None)] {{(pid=117821) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 05:25:04.638116 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-6d67e647-d3f9-4778-abef-556bb40ac09f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "POST /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.435396 Jul 29 05:25:04.639054 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 242/518] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Jul 29 05:25:04 2022] POST /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171/os-volume_attachments => generated 194 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:25:04.659059 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-1c53c2c5-ef34-47f1-af46-dc60f69d2586 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:04.659851 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-1c53c2c5-ef34-47f1-af46-dc60f69d2586 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:04.673864 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1c53c2c5-ef34-47f1-af46-dc60f69d2586 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:04.674565 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1c53c2c5-ef34-47f1-af46-dc60f69d2586 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:04.675817 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1c53c2c5-ef34-47f1-af46-dc60f69d2586 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:04.676438 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1c53c2c5-ef34-47f1-af46-dc60f69d2586 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:04.906090 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-cced0c75-c72d-4e1e-9cb3-d0265522ac5f tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Flavor limits 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 05:25:04.907046 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-cced0c75-c72d-4e1e-9cb3-d0265522ac5f tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Image limits 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 05:25:04.907872 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-cced0c75-c72d-4e1e-9cb3-d0265522ac5f tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Flavor pref 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 05:25:04.908285 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-cced0c75-c72d-4e1e-9cb3-d0265522ac5f tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Image pref 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 05:25:04.908747 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-cced0c75-c72d-4e1e-9cb3-d0265522ac5f tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 05:25:04.920498 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-cced0c75-c72d-4e1e-9cb3-d0265522ac5f tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:04.921837 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-cced0c75-c72d-4e1e-9cb3-d0265522ac5f tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:04.923809 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-cced0c75-c72d-4e1e-9cb3-d0265522ac5f tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:04.924699 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-cced0c75-c72d-4e1e-9cb3-d0265522ac5f tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:04.949691 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.quota [None req-cced0c75-c72d-4e1e-9cb3-d0265522ac5f tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Getting quotas for project 1f75331a524c4a5a981dfd1fdc361467. Resources: {'instances', 'ram', 'cores'} {{(pid=117821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:25:04.953844 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.quota [None req-cced0c75-c72d-4e1e-9cb3-d0265522ac5f tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Getting quotas for user 1690be2d7032472391fa96e23e0c1bf0 and project 1f75331a524c4a5a981dfd1fdc361467. Resources: {'instances', 'ram', 'cores'} {{(pid=117821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:25:04.972200 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-cced0c75-c72d-4e1e-9cb3-d0265522ac5f tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Going to run 1 instances... {{(pid=117821) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 05:25:04.976216 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-cced0c75-c72d-4e1e-9cb3-d0265522ac5f tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 87501cee-ef3c-4bdb-942c-3fc67c1032d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b7bf870d-4e7c-42fd-849f-72ac19277493',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117821) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 05:25:05.036354 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-cced0c75-c72d-4e1e-9cb3-d0265522ac5f tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.667893 Jul 29 05:25:05.037652 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 277/519] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 05:25:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 29 05:25:05.046367 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-1c53c2c5-ef34-47f1-af46-dc60f69d2586 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:05.051012 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-6fd69f31-dcb9-4d80-9b0a-3fb85780d7ba tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:05.051667 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-6fd69f31-dcb9-4d80-9b0a-3fb85780d7ba tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:05.066905 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6fd69f31-dcb9-4d80-9b0a-3fb85780d7ba tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:05.067667 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6fd69f31-dcb9-4d80-9b0a-3fb85780d7ba tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:05.069260 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6fd69f31-dcb9-4d80-9b0a-3fb85780d7ba tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:05.069772 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6fd69f31-dcb9-4d80-9b0a-3fb85780d7ba tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:05.081013 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-1c53c2c5-ef34-47f1-af46-dc60f69d2586 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780" status: 200 len: 1679 microversion: 2.1 time: 0.440008 Jul 29 05:25:05.082083 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 243/520] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:04 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 => generated 1679 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:05.109418 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-893b1874-7934-426c-bb5e-490c1875cede tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:05.120907 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-893b1874-7934-426c-bb5e-490c1875cede tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 87501cee-ef3c-4bdb-942c-3fc67c1032d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:05.235699 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-893b1874-7934-426c-bb5e-490c1875cede tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:05.245750 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-893b1874-7934-426c-bb5e-490c1875cede tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0" status: 200 len: 1219 microversion: 2.1 time: 0.158076 Jul 29 05:25:05.246737 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 244/521] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:05 2022] GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0 => generated 1219 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:05.305180 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-6fd69f31-dcb9-4d80-9b0a-3fb85780d7ba tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:05.310930 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-a8cc025a-d92b-4f9f-a8c6-bbf9562537d5 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:05.311723 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-a8cc025a-d92b-4f9f-a8c6-bbf9562537d5 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: dbc57534-e5bb-434a-a446-eb402deff943] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:05.316219 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-6fd69f31-dcb9-4d80-9b0a-3fb85780d7ba tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:05.319023 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-6fd69f31-dcb9-4d80-9b0a-3fb85780d7ba tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:05.320782 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-6fd69f31-dcb9-4d80-9b0a-3fb85780d7ba tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1807 microversion: 2.20 time: 0.281972 Jul 29 05:25:05.321948 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 278/522] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:25:05 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1807 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:25:05.351056 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a8cc025a-d92b-4f9f-a8c6-bbf9562537d5 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:05.353101 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a8cc025a-d92b-4f9f-a8c6-bbf9562537d5 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:05.354035 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a8cc025a-d92b-4f9f-a8c6-bbf9562537d5 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:05.354458 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a8cc025a-d92b-4f9f-a8c6-bbf9562537d5 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:05.380967 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-5d3578e0-1851-442c-a5e6-0ed124f7f310 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:25:05.392845 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5d3578e0-1851-442c-a5e6-0ed124f7f310 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:05.393614 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5d3578e0-1851-442c-a5e6-0ed124f7f310 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:05.445878 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-5d3578e0-1851-442c-a5e6-0ed124f7f310 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Going to try to stop instance {{(pid=117821) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 29 05:25:05.508278 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-5d3578e0-1851-442c-a5e6-0ed124f7f310 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "POST /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba/action" status: 202 len: 0 microversion: 2.1 time: 0.126812 Jul 29 05:25:05.508278 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 279/523] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Jul 29 05:25:05 2022] POST /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 05:25:05.516170 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-c5b3f21f-3f07-40e9-a4a1-edeb7ac24aa3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:05.516990 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-c5b3f21f-3f07-40e9-a4a1-edeb7ac24aa3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:05.526758 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c5b3f21f-3f07-40e9-a4a1-edeb7ac24aa3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:05.527573 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c5b3f21f-3f07-40e9-a4a1-edeb7ac24aa3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:05.528801 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c5b3f21f-3f07-40e9-a4a1-edeb7ac24aa3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:05.529502 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c5b3f21f-3f07-40e9-a4a1-edeb7ac24aa3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:05.722332 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-a8cc025a-d92b-4f9f-a8c6-bbf9562537d5 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:05.734737 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-a8cc025a-d92b-4f9f-a8c6-bbf9562537d5 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943" status: 200 len: 1313 microversion: 2.1 time: 0.428692 Jul 29 05:25:05.736135 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 245/524] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:05 2022] GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943 => generated 1313 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:25:05.856524 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-c5b3f21f-3f07-40e9-a4a1-edeb7ac24aa3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:05.873652 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-c5b3f21f-3f07-40e9-a4a1-edeb7ac24aa3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1677 microversion: 2.1 time: 0.363222 Jul 29 05:25:05.875461 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 280/525] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:05 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1677 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:06.036484 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-719782bb-4f72-4097-b1bd-af619f82438e req-7c2c65ea-04c4-455c-8d70-4bd5b2c9a656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c46947-e368-441d-9e07-584e95d55780", "name": "network-vif-deleted", "tag": "a271d975-09dc-4c3e-8b57-3468787c62a8"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:25:06.048873 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-719782bb-4f72-4097-b1bd-af619f82438e req-7c2c65ea-04c4-455c-8d70-4bd5b2c9a656 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:06.049475 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-719782bb-4f72-4097-b1bd-af619f82438e req-7c2c65ea-04c4-455c-8d70-4bd5b2c9a656 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:06.063770 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-719782bb-4f72-4097-b1bd-af619f82438e req-7c2c65ea-04c4-455c-8d70-4bd5b2c9a656 service nova] Creating event network-vif-deleted:a271d975-09dc-4c3e-8b57-3468787c62a8 for instance 05c46947-e368-441d-9e07-584e95d55780 on hv-cinder-85127 Jul 29 05:25:06.070061 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-719782bb-4f72-4097-b1bd-af619f82438e req-7c2c65ea-04c4-455c-8d70-4bd5b2c9a656 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036490 Jul 29 05:25:06.070566 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 246/526] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:25:06.120796 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-94f76d6d-171c-4126-aa0e-082a5cb7af0d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:06.121392 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-94f76d6d-171c-4126-aa0e-082a5cb7af0d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:06.128319 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-94f76d6d-171c-4126-aa0e-082a5cb7af0d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:06.128775 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-94f76d6d-171c-4126-aa0e-082a5cb7af0d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:06.129573 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-94f76d6d-171c-4126-aa0e-082a5cb7af0d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:06.130015 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-94f76d6d-171c-4126-aa0e-082a5cb7af0d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:06.211171 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-94f76d6d-171c-4126-aa0e-082a5cb7af0d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:06.219291 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-94f76d6d-171c-4126-aa0e-082a5cb7af0d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780" status: 200 len: 1612 microversion: 2.1 time: 0.102649 Jul 29 05:25:06.220084 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 281/527] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:06 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 => generated 1612 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:06.294906 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-30472cf2-78a8-4044-941d-098bfedf513d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:06.296504 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-30472cf2-78a8-4044-941d-098bfedf513d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 87501cee-ef3c-4bdb-942c-3fc67c1032d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:06.307841 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-30472cf2-78a8-4044-941d-098bfedf513d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:06.309153 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-30472cf2-78a8-4044-941d-098bfedf513d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:06.310879 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-30472cf2-78a8-4044-941d-098bfedf513d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:06.312065 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-30472cf2-78a8-4044-941d-098bfedf513d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:06.351399 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-a77cce40-6cdc-4769-8747-c2d9ebd745c1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:06.352222 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-a77cce40-6cdc-4769-8747-c2d9ebd745c1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:06.363216 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a77cce40-6cdc-4769-8747-c2d9ebd745c1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:06.363787 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a77cce40-6cdc-4769-8747-c2d9ebd745c1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:06.365667 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a77cce40-6cdc-4769-8747-c2d9ebd745c1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:06.366258 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a77cce40-6cdc-4769-8747-c2d9ebd745c1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:06.388950 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:25:06.434669 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-30472cf2-78a8-4044-941d-098bfedf513d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:06.453969 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-30472cf2-78a8-4044-941d-098bfedf513d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0" status: 200 len: 1223 microversion: 2.1 time: 0.166771 Jul 29 05:25:06.455576 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 247/528] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:06 2022] GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0 => generated 1223 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:06.583079 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-a77cce40-6cdc-4769-8747-c2d9ebd745c1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:06.594272 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-a77cce40-6cdc-4769-8747-c2d9ebd745c1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:06.596151 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-a77cce40-6cdc-4769-8747-c2d9ebd745c1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:06.597364 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-a77cce40-6cdc-4769-8747-c2d9ebd745c1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1807 microversion: 2.20 time: 0.252128 Jul 29 05:25:06.597935 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 282/529] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:25:06 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1807 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:25:06.768991 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-d38e39a9-5d2a-40c7-b4d4-2e5f3e09a839 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:06.769828 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-d38e39a9-5d2a-40c7-b4d4-2e5f3e09a839 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: dbc57534-e5bb-434a-a446-eb402deff943] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:06.777986 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d38e39a9-5d2a-40c7-b4d4-2e5f3e09a839 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:06.778432 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d38e39a9-5d2a-40c7-b4d4-2e5f3e09a839 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:06.779214 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d38e39a9-5d2a-40c7-b4d4-2e5f3e09a839 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:06.779685 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d38e39a9-5d2a-40c7-b4d4-2e5f3e09a839 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:06.924436 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-2e16c8e5-8fed-47d7-a666-4b8485309330 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:06.928652 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-2e16c8e5-8fed-47d7-a666-4b8485309330 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:06.947249 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2e16c8e5-8fed-47d7-a666-4b8485309330 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:06.948419 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2e16c8e5-8fed-47d7-a666-4b8485309330 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:06.950023 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2e16c8e5-8fed-47d7-a666-4b8485309330 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:06.951064 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2e16c8e5-8fed-47d7-a666-4b8485309330 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:06.963236 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-d38e39a9-5d2a-40c7-b4d4-2e5f3e09a839 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:06.972604 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-d38e39a9-5d2a-40c7-b4d4-2e5f3e09a839 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943" status: 200 len: 1313 microversion: 2.1 time: 0.207791 Jul 29 05:25:06.987491 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 248/530] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:06 2022] GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943 => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:07.148995 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-2e16c8e5-8fed-47d7-a666-4b8485309330 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:07.157632 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-2e16c8e5-8fed-47d7-a666-4b8485309330 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1677 microversion: 2.1 time: 0.263673 Jul 29 05:25:07.158346 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 283/531] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:06 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1677 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:07.247008 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-b818d421-809a-462a-94d5-32db8026659e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:07.248212 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-b818d421-809a-462a-94d5-32db8026659e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:07.262598 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b818d421-809a-462a-94d5-32db8026659e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:07.275795 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b818d421-809a-462a-94d5-32db8026659e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:07.285445 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b818d421-809a-462a-94d5-32db8026659e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:07.285445 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b818d421-809a-462a-94d5-32db8026659e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:07.405716 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-b818d421-809a-462a-94d5-32db8026659e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:07.420726 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-b818d421-809a-462a-94d5-32db8026659e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780" status: 200 len: 1326 microversion: 2.1 time: 0.181927 Jul 29 05:25:07.422108 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 249/532] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:07 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 => generated 1326 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:07.487432 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-192673fc-9e60-42c1-bb33-77690ce19a51 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:07.488051 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-192673fc-9e60-42c1-bb33-77690ce19a51 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 87501cee-ef3c-4bdb-942c-3fc67c1032d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:07.495882 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-192673fc-9e60-42c1-bb33-77690ce19a51 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:07.496511 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-192673fc-9e60-42c1-bb33-77690ce19a51 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:07.497109 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-192673fc-9e60-42c1-bb33-77690ce19a51 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:07.497550 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-192673fc-9e60-42c1-bb33-77690ce19a51 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:07.566926 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-192673fc-9e60-42c1-bb33-77690ce19a51 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:07.574660 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-192673fc-9e60-42c1-bb33-77690ce19a51 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0" status: 200 len: 1215 microversion: 2.1 time: 0.091282 Jul 29 05:25:07.575231 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 284/533] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:07 2022] GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0 => generated 1215 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:07.624052 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-a5668b04-3a8b-4330-af90-f94fa6c2ce57 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:07.624656 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-a5668b04-3a8b-4330-af90-f94fa6c2ce57 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:07.631814 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a5668b04-3a8b-4330-af90-f94fa6c2ce57 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:07.632265 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a5668b04-3a8b-4330-af90-f94fa6c2ce57 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:07.633056 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a5668b04-3a8b-4330-af90-f94fa6c2ce57 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:07.633495 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a5668b04-3a8b-4330-af90-f94fa6c2ce57 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:07.780694 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-a5668b04-3a8b-4330-af90-f94fa6c2ce57 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:07.794225 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-a5668b04-3a8b-4330-af90-f94fa6c2ce57 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:07.795897 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-a5668b04-3a8b-4330-af90-f94fa6c2ce57 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:07.797385 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-a5668b04-3a8b-4330-af90-f94fa6c2ce57 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1794 microversion: 2.20 time: 0.177293 Jul 29 05:25:07.798068 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 250/534] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:25:07 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1794 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:25:08.009680 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-f8c7d312-790e-4a12-952e-6fd89473935c tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:08.010717 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-f8c7d312-790e-4a12-952e-6fd89473935c tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: dbc57534-e5bb-434a-a446-eb402deff943] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:08.017512 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f8c7d312-790e-4a12-952e-6fd89473935c tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:08.017951 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f8c7d312-790e-4a12-952e-6fd89473935c tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:08.018725 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f8c7d312-790e-4a12-952e-6fd89473935c tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:08.019159 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f8c7d312-790e-4a12-952e-6fd89473935c tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:08.184235 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-4093e8f2-9401-4c0a-a6eb-3da0b3e1b060 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:08.185558 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-4093e8f2-9401-4c0a-a6eb-3da0b3e1b060 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:08.197027 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-4093e8f2-9401-4c0a-a6eb-3da0b3e1b060 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:08.198048 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-4093e8f2-9401-4c0a-a6eb-3da0b3e1b060 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:08.199681 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-4093e8f2-9401-4c0a-a6eb-3da0b3e1b060 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:08.208024 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-4093e8f2-9401-4c0a-a6eb-3da0b3e1b060 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:08.227375 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-f8c7d312-790e-4a12-952e-6fd89473935c tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:08.237834 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-f8c7d312-790e-4a12-952e-6fd89473935c tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943" status: 200 len: 1497 microversion: 2.1 time: 0.235414 Jul 29 05:25:08.238746 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 285/535] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:08 2022] GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943 => generated 1497 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:08.377109 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-4093e8f2-9401-4c0a-a6eb-3da0b3e1b060 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:08.379534 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:25:08.389366 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-4093e8f2-9401-4c0a-a6eb-3da0b3e1b060 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1677 microversion: 2.1 time: 0.213061 Jul 29 05:25:08.390079 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 251/536] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:08 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1677 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:08.442199 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-af4e918a-ff0b-4f84-8292-338fd51ae931 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:08.442853 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-af4e918a-ff0b-4f84-8292-338fd51ae931 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:08.462997 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-af4e918a-ff0b-4f84-8292-338fd51ae931 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:08.463487 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-af4e918a-ff0b-4f84-8292-338fd51ae931 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:08.464311 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-af4e918a-ff0b-4f84-8292-338fd51ae931 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:08.464753 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-af4e918a-ff0b-4f84-8292-338fd51ae931 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:08.503045 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-af4e918a-ff0b-4f84-8292-338fd51ae931 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:08.503714 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-af4e918a-ff0b-4f84-8292-338fd51ae931 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:08.503967 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.objects.instance [None req-af4e918a-ff0b-4f84-8292-338fd51ae931 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lazy-loading 'fault' on Instance uuid 05c46947-e368-441d-9e07-584e95d55780 {{(pid=117821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:25:08.550802 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-af4e918a-ff0b-4f84-8292-338fd51ae931 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:08.561639 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-af4e918a-ff0b-4f84-8292-338fd51ae931 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780" status: 200 len: 1331 microversion: 2.1 time: 0.123358 Jul 29 05:25:08.563409 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 286/537] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:08 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 => generated 1331 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:08.615581 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-b16d476a-3762-41c5-a3d4-2cd28f32f566 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:08.616247 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-b16d476a-3762-41c5-a3d4-2cd28f32f566 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 87501cee-ef3c-4bdb-942c-3fc67c1032d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:08.623831 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b16d476a-3762-41c5-a3d4-2cd28f32f566 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:08.624277 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b16d476a-3762-41c5-a3d4-2cd28f32f566 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:08.625055 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b16d476a-3762-41c5-a3d4-2cd28f32f566 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:08.625519 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b16d476a-3762-41c5-a3d4-2cd28f32f566 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:08.705850 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-b16d476a-3762-41c5-a3d4-2cd28f32f566 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:08.723473 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-b16d476a-3762-41c5-a3d4-2cd28f32f566 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0" status: 200 len: 1271 microversion: 2.1 time: 0.112250 Jul 29 05:25:08.729546 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 252/538] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:08 2022] GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0 => generated 1271 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:08.783536 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-72c9e918-951d-4c1a-bbd0-81d48c0a7930 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:08.784046 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-72c9e918-951d-4c1a-bbd0-81d48c0a7930 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: dbc57534-e5bb-434a-a446-eb402deff943] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:08.792689 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-72c9e918-951d-4c1a-bbd0-81d48c0a7930 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:08.793146 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-72c9e918-951d-4c1a-bbd0-81d48c0a7930 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:08.793937 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-72c9e918-951d-4c1a-bbd0-81d48c0a7930 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:08.794409 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-72c9e918-951d-4c1a-bbd0-81d48c0a7930 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:08.825423 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-72c9e918-951d-4c1a-bbd0-81d48c0a7930 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: dbc57534-e5bb-434a-a446-eb402deff943] Going to try to terminate instance {{(pid=117821) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 05:25:08.946770 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-72c9e918-951d-4c1a-bbd0-81d48c0a7930 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "DELETE /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943" status: 204 len: 0 microversion: 2.1 time: 0.168009 Jul 29 05:25:08.947587 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 287/539] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 05:25:08 2022] DELETE /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 05:25:08.959593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-e76a498b-1841-4f45-b541-3577ade35bf3 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:08.960991 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-e76a498b-1841-4f45-b541-3577ade35bf3 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: dbc57534-e5bb-434a-a446-eb402deff943] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:08.964030 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:25:08.997101 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e76a498b-1841-4f45-b541-3577ade35bf3 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:08.997645 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e76a498b-1841-4f45-b541-3577ade35bf3 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:08.998502 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e76a498b-1841-4f45-b541-3577ade35bf3 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:08.999016 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e76a498b-1841-4f45-b541-3577ade35bf3 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:09.187028 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-e76a498b-1841-4f45-b541-3577ade35bf3 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:09.200073 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-e76a498b-1841-4f45-b541-3577ade35bf3 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943" status: 200 len: 1503 microversion: 2.1 time: 0.247499 Jul 29 05:25:09.201220 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 253/540] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:08 2022] GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943 => generated 1503 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:09.289834 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-616bbe35-4416-444f-a3ff-56c5f8bb0b19 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:25:09.292349 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-616bbe35-4416-444f-a3ff-56c5f8bb0b19 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:09.298867 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-616bbe35-4416-444f-a3ff-56c5f8bb0b19 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:09.299319 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-616bbe35-4416-444f-a3ff-56c5f8bb0b19 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:09.300127 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-616bbe35-4416-444f-a3ff-56c5f8bb0b19 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:09.300564 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-616bbe35-4416-444f-a3ff-56c5f8bb0b19 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:09.326524 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.objects.instance [None req-616bbe35-4416-444f-a3ff-56c5f8bb0b19 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lazy-loading 'flavor' on Instance uuid 00171c99-cf39-4ed6-b78a-3bb24272b171 {{(pid=117821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:25:09.417871 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-94b07042-1336-44fa-9c8b-3dea2a222241 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:09.418758 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-94b07042-1336-44fa-9c8b-3dea2a222241 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:09.429908 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-94b07042-1336-44fa-9c8b-3dea2a222241 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:09.430922 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-94b07042-1336-44fa-9c8b-3dea2a222241 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:09.432431 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-94b07042-1336-44fa-9c8b-3dea2a222241 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:09.433225 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-94b07042-1336-44fa-9c8b-3dea2a222241 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:09.482313 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-616bbe35-4416-444f-a3ff-56c5f8bb0b19 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "POST /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171/action" status: 200 len: 32 microversion: 2.1 time: 0.197032 Jul 29 05:25:09.483274 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 288/541] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Jul 29 05:25:09 2022] POST /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171/action => generated 32 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 05:25:09.499304 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-38f34e6b-be67-4b7f-b0c8-18c52be49cd8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:09.500588 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-38f34e6b-be67-4b7f-b0c8-18c52be49cd8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:09.508764 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-38f34e6b-be67-4b7f-b0c8-18c52be49cd8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:09.509472 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-38f34e6b-be67-4b7f-b0c8-18c52be49cd8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:09.509977 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-38f34e6b-be67-4b7f-b0c8-18c52be49cd8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:09.510574 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-38f34e6b-be67-4b7f-b0c8-18c52be49cd8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:09.609731 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-94b07042-1336-44fa-9c8b-3dea2a222241 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:09.618907 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-94b07042-1336-44fa-9c8b-3dea2a222241 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1677 microversion: 2.1 time: 0.205687 Jul 29 05:25:09.619547 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 254/542] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:09 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1677 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:25:09.624735 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-986b091f-098b-46fd-8d6e-d2a3eab22bfd tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:09.625447 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-986b091f-098b-46fd-8d6e-d2a3eab22bfd tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:09.633109 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-986b091f-098b-46fd-8d6e-d2a3eab22bfd tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:09.633570 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-986b091f-098b-46fd-8d6e-d2a3eab22bfd tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:09.634356 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-986b091f-098b-46fd-8d6e-d2a3eab22bfd tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:09.634792 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-986b091f-098b-46fd-8d6e-d2a3eab22bfd tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:09.650403 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.wsgi [None req-986b091f-098b-46fd-8d6e-d2a3eab22bfd tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] HTTP exception thrown: Instance 05c46947-e368-441d-9e07-584e95d55780 could not be found. Jul 29 05:25:09.652139 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-986b091f-098b-46fd-8d6e-d2a3eab22bfd tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Request method failure captured: Jul 29 05:25:09.652139 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: request: GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 HTTP/1.1 Jul 29 05:25:09.652139 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept: application/json Jul 29 05:25:09.652139 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept-Encoding: identity Jul 29 05:25:09.652139 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Connection: close Jul 29 05:25:09.652139 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Length: 0 Jul 29 05:25:09.652139 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Type: application/json Jul 29 05:25:09.652139 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Host: 10.222.0.49 Jul 29 05:25:09.652139 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Openstack-System-Scope: None Jul 29 05:25:09.652139 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: User-Agent: python-urllib3/1.26.10 Jul 29 05:25:09.652139 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Auth-Token: gAAAAABi425JZwki5zTQDTC3iukDv4VCbNzlxQK73dr9mClVYcp-Pvpl82CYunlqvLixJfXv6lMCmXCQFs-hx71b40CIPEvZNAkIclM8nEjPEEMC1q8Qnidc9zW9MB-6S0Nkj4s67ZnGkNw0VjcX1sLTyzzsa2KGY_dj5NlUwZaoPl1fActyKvM Jul 29 05:25:09.652139 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Id: None Jul 29 05:25:09.652139 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Name: None Jul 29 05:25:09.652139 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Identity-Status: Confirmed Jul 29 05:25:09.652139 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Is-Admin-Project: True Jul 29 05:25:09.652139 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Id: default Jul 29 05:25:09.652139 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Name: Default Jul 29 05:25:09.652139 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Id: 9d8baaf2e23546ee8ed1de278617c7d2 Jul 29 05:25:09.652139 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Name: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:25:09.652139 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Role: member,reader Jul 29 05:25:09.652139 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Roles: member,reader Jul 29 05:25:09.654624 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:25:09.654624 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:25:09.654624 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Id: 9d8baaf2e23546ee8ed1de278617c7d2 Jul 29 05:25:09.654624 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:25:09.654624 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User: tempest-AttachVolumeNegativeTest-480684510-project Jul 29 05:25:09.654624 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Id: default Jul 29 05:25:09.654624 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Name: Default Jul 29 05:25:09.654624 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Id: 3c60b3a983f14f50b1b762a3954a1059 Jul 29 05:25:09.654624 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Name: tempest-AttachVolumeNegativeTest-480684510-project Jul 29 05:25:09.654624 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: method: > Jul 29 05:25:09.654624 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: exception: Instance 05c46947-e368-441d-9e07-584e95d55780 could not be found. Jul 29 05:25:09.654624 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: action_args: {'id': '05c46947-e368-441d-9e07-584e95d55780'} Jul 29 05:25:09.656589 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:25:09.656589 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:25:09.656589 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:25:09.656589 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:25:09.656589 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:25:09.656589 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:25:09.656589 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:25:09.656589 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:25:09.656589 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:25:09.656589 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:25:09.656589 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05c46947-e368-441d-9e07-584e95d55780 could not be found. Jul 29 05:25:09.656589 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:25:09.656589 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:25:09.656589 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:25:09.656589 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:25:09.656589 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:25:09.656589 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:25:09.656589 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:25:09.656589 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:25:09.656589 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:25:09.659141 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:25:09.659141 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:25:09.659141 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:25:09.659141 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:25:09.659141 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:25:09.659141 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:25:09.659141 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:25:09.659141 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05c46947-e368-441d-9e07-584e95d55780 could not be found. Jul 29 05:25:09.659141 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:25:09.659141 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:25:09.659141 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:25:09.659141 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:25:09.659141 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:25:09.659141 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:25:09.659141 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:25:09.659141 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:25:09.659141 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05c46947-e368-441d-9e07-584e95d55780 could not be found. Jul 29 05:25:09.659141 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:25:09.662825 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-986b091f-098b-46fd-8d6e-d2a3eab22bfd tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Returning 404 to user: Instance 05c46947-e368-441d-9e07-584e95d55780 could not be found. {{(pid=117820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:25:09.662825 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-986b091f-098b-46fd-8d6e-d2a3eab22bfd tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780" status: 404 len: 111 microversion: 2.1 time: 0.032972 Jul 29 05:25:09.662825 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 255/543] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:09 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:25:09.665855 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-15c07588-0dc0-4d1a-940d-a6aa43f311c6 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '.version_select at 0x7fa63ad7b700>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:09.687753 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-15c07588-0dc0-4d1a-940d-a6aa43f311c6 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-716991338" status: 202 len: 0 microversion: 2.1 time: 0.026260 Jul 29 05:25:09.688830 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 256/544] 10.222.0.49 () {58 vars in 1218 bytes} [Fri Jul 29 05:25:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-716991338 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 05:25:09.690131 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-38f34e6b-be67-4b7f-b0c8-18c52be49cd8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:09.700519 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-38f34e6b-be67-4b7f-b0c8-18c52be49cd8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1737 microversion: 2.1 time: 0.208672 Jul 29 05:25:09.701114 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 289/545] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:09 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1737 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:25:09.752555 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-97dfd3f8-687a-4fde-8e7c-5032351b8655 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:09.753233 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-97dfd3f8-687a-4fde-8e7c-5032351b8655 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 87501cee-ef3c-4bdb-942c-3fc67c1032d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:09.760460 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-97dfd3f8-687a-4fde-8e7c-5032351b8655 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:09.760926 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-97dfd3f8-687a-4fde-8e7c-5032351b8655 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:09.761694 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-97dfd3f8-687a-4fde-8e7c-5032351b8655 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:09.762134 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-97dfd3f8-687a-4fde-8e7c-5032351b8655 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:09.862089 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-97dfd3f8-687a-4fde-8e7c-5032351b8655 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:09.871765 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-97dfd3f8-687a-4fde-8e7c-5032351b8655 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0" status: 200 len: 1289 microversion: 2.1 time: 0.123025 Jul 29 05:25:09.872272 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 257/546] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:09 2022] GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0 => generated 1289 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:10.238233 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-b1899e1d-a7e5-49a3-822c-de94137cfb7a tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:10.240430 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-b1899e1d-a7e5-49a3-822c-de94137cfb7a tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: dbc57534-e5bb-434a-a446-eb402deff943] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:10.254770 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b1899e1d-a7e5-49a3-822c-de94137cfb7a tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:10.256736 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b1899e1d-a7e5-49a3-822c-de94137cfb7a tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:10.258492 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b1899e1d-a7e5-49a3-822c-de94137cfb7a tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:10.259753 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b1899e1d-a7e5-49a3-822c-de94137cfb7a tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:10.644389 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-9678e000-294c-46f0-9290-8e167ad9080b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:10.647144 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-9678e000-294c-46f0-9290-8e167ad9080b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:10.657694 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9678e000-294c-46f0-9290-8e167ad9080b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:10.659208 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9678e000-294c-46f0-9290-8e167ad9080b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:10.660782 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9678e000-294c-46f0-9290-8e167ad9080b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:10.661530 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9678e000-294c-46f0-9290-8e167ad9080b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:10.701934 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-b1899e1d-a7e5-49a3-822c-de94137cfb7a tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:10.714856 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-b1899e1d-a7e5-49a3-822c-de94137cfb7a tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943" status: 200 len: 1503 microversion: 2.1 time: 0.492796 Jul 29 05:25:10.717964 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 290/547] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:10 2022] GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943 => generated 1503 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:10.726982 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-9ff1c2cc-b23d-41ae-a3a6-912bcb4dd131 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:10.727638 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-9ff1c2cc-b23d-41ae-a3a6-912bcb4dd131 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:10.748923 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9ff1c2cc-b23d-41ae-a3a6-912bcb4dd131 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:10.749379 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9ff1c2cc-b23d-41ae-a3a6-912bcb4dd131 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:10.750247 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9ff1c2cc-b23d-41ae-a3a6-912bcb4dd131 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:10.750902 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9ff1c2cc-b23d-41ae-a3a6-912bcb4dd131 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:11.031095 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-9ff1c2cc-b23d-41ae-a3a6-912bcb4dd131 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:11.041350 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-9ff1c2cc-b23d-41ae-a3a6-912bcb4dd131 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1737 microversion: 2.1 time: 0.322255 Jul 29 05:25:11.056200 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 291/548] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:10 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1737 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:11.065751 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-89ded472-4365-4dc1-be99-9fb8fc6d9738 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Action: 'create', calling method: .version_select at 0x7fa63ac74e50>, body: {"keypair": {"name": "tempest-keypair-1673634664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8vhtqyTaeW+HS15VwezUdVhEbr5adrD+5SMJodIJyQsnjDfzSBLxNhwi2Pr2/Bjj8u36acf7IyrNGu6giY5G3mgog3ab3fDmgA6wmvio+nUrisetkJEAvrwxdYe5AkUw=="}} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:25:11.075342 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:25:11.089832 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.quota [None req-89ded472-4365-4dc1-be99-9fb8fc6d9738 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Getting quotas for project 9d8baaf2e23546ee8ed1de278617c7d2. Resources: {'key_pairs'} {{(pid=117821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:25:11.095636 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.quota [None req-89ded472-4365-4dc1-be99-9fb8fc6d9738 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Getting quotas for user 3c60b3a983f14f50b1b762a3954a1059 and project 9d8baaf2e23546ee8ed1de278617c7d2. Resources: {'key_pairs'} {{(pid=117821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:25:11.126862 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-89ded472-4365-4dc1-be99-9fb8fc6d9738 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.064988 Jul 29 05:25:11.127948 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 292/549] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Jul 29 05:25:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:25:11.147376 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-fed39856-166f-4ea4-8740-d63d060052fc tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:11.148215 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-fed39856-166f-4ea4-8740-d63d060052fc tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 87501cee-ef3c-4bdb-942c-3fc67c1032d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:11.153269 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-9678e000-294c-46f0-9290-8e167ad9080b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:11.156454 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-fed39856-166f-4ea4-8740-d63d060052fc tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:11.156909 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-fed39856-166f-4ea4-8740-d63d060052fc tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:11.158000 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-fed39856-166f-4ea4-8740-d63d060052fc tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:11.158605 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-fed39856-166f-4ea4-8740-d63d060052fc tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:11.188489 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-9678e000-294c-46f0-9290-8e167ad9080b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1677 microversion: 2.1 time: 0.549247 Jul 29 05:25:11.189270 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 258/550] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:10 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1677 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:25:11.307849 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-fed39856-166f-4ea4-8740-d63d060052fc tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:11.317161 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-fed39856-166f-4ea4-8740-d63d060052fc tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0" status: 200 len: 1277 microversion: 2.1 time: 0.187710 Jul 29 05:25:11.319735 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 293/551] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:11 2022] GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0 => generated 1277 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:11.589270 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-5140b0e5-a851-4b64-bbff-d3ee5ab9b9d2 req-ad099b2c-e341-42ad-b167-bb67a59adfd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc57534-e5bb-434a-a446-eb402deff943", "name": "network-vif-deleted", "tag": "7c6f28e6-8fef-44a6-b55e-ca2e7b493160"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:25:11.605797 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-5140b0e5-a851-4b64-bbff-d3ee5ab9b9d2 req-ad099b2c-e341-42ad-b167-bb67a59adfd3 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:11.606923 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-5140b0e5-a851-4b64-bbff-d3ee5ab9b9d2 req-ad099b2c-e341-42ad-b167-bb67a59adfd3 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:11.628138 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-5140b0e5-a851-4b64-bbff-d3ee5ab9b9d2 req-ad099b2c-e341-42ad-b167-bb67a59adfd3 service nova] Creating event network-vif-deleted:7c6f28e6-8fef-44a6-b55e-ca2e7b493160 for instance dbc57534-e5bb-434a-a446-eb402deff943 on hv-cinder-85127 Jul 29 05:25:11.670608 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-5140b0e5-a851-4b64-bbff-d3ee5ab9b9d2 req-ad099b2c-e341-42ad-b167-bb67a59adfd3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086764 Jul 29 05:25:11.672735 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 259/552] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:25:11.747403 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-e51afedd-b0fb-4939-bab3-2503cccf7090 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:11.748953 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-e51afedd-b0fb-4939-bab3-2503cccf7090 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: dbc57534-e5bb-434a-a446-eb402deff943] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:11.757267 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e51afedd-b0fb-4939-bab3-2503cccf7090 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:11.758238 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e51afedd-b0fb-4939-bab3-2503cccf7090 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:11.759391 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e51afedd-b0fb-4939-bab3-2503cccf7090 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:11.760123 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e51afedd-b0fb-4939-bab3-2503cccf7090 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:11.826943 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e51afedd-b0fb-4939-bab3-2503cccf7090 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:11.829297 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e51afedd-b0fb-4939-bab3-2503cccf7090 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:11.829938 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.objects.instance [None req-e51afedd-b0fb-4939-bab3-2503cccf7090 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lazy-loading 'fault' on Instance uuid dbc57534-e5bb-434a-a446-eb402deff943 {{(pid=117821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:25:11.894614 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-e51afedd-b0fb-4939-bab3-2503cccf7090 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27709d338705483b97997fcfd48d1d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28baf3f14f74766b11c9ee459b8d5ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:11.914855 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-e51afedd-b0fb-4939-bab3-2503cccf7090 tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943" status: 200 len: 1303 microversion: 2.1 time: 0.165115 Jul 29 05:25:11.914855 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 294/553] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:11 2022] GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943 => generated 1303 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:12.069104 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-f8b3d85d-c06e-4d89-ac9b-4d9fc3dda173 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:12.069989 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-f8b3d85d-c06e-4d89-ac9b-4d9fc3dda173 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:12.094613 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f8b3d85d-c06e-4d89-ac9b-4d9fc3dda173 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:12.096687 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f8b3d85d-c06e-4d89-ac9b-4d9fc3dda173 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:12.098295 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f8b3d85d-c06e-4d89-ac9b-4d9fc3dda173 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:12.099630 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f8b3d85d-c06e-4d89-ac9b-4d9fc3dda173 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:12.211441 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-517a8ee6-7bb8-4b19-a149-1f852936275b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:12.212228 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-517a8ee6-7bb8-4b19-a149-1f852936275b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:12.220910 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-517a8ee6-7bb8-4b19-a149-1f852936275b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:12.221778 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-517a8ee6-7bb8-4b19-a149-1f852936275b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:12.224620 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-517a8ee6-7bb8-4b19-a149-1f852936275b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:12.225541 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-517a8ee6-7bb8-4b19-a149-1f852936275b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:12.398487 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-517a8ee6-7bb8-4b19-a149-1f852936275b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:12.402615 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:25:12.408785 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-517a8ee6-7bb8-4b19-a149-1f852936275b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1677 microversion: 2.1 time: 0.201797 Jul 29 05:25:12.409463 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 295/554] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:12 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1677 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:25:12.416879 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-2c4632a7-e92d-45e0-a820-83c57b5cff70 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:12.417503 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-2c4632a7-e92d-45e0-a820-83c57b5cff70 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 87501cee-ef3c-4bdb-942c-3fc67c1032d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:12.429466 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2c4632a7-e92d-45e0-a820-83c57b5cff70 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:12.429931 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2c4632a7-e92d-45e0-a820-83c57b5cff70 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:12.430985 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2c4632a7-e92d-45e0-a820-83c57b5cff70 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:12.431461 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2c4632a7-e92d-45e0-a820-83c57b5cff70 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:12.604505 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-f8b3d85d-c06e-4d89-ac9b-4d9fc3dda173 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:12.627032 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-f8b3d85d-c06e-4d89-ac9b-4d9fc3dda173 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1737 microversion: 2.1 time: 0.567312 Jul 29 05:25:12.627999 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 260/555] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:12 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1737 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:12.641264 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-2c4632a7-e92d-45e0-a820-83c57b5cff70 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:12.656509 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-2c4632a7-e92d-45e0-a820-83c57b5cff70 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0" status: 200 len: 1319 microversion: 2.1 time: 0.245623 Jul 29 05:25:12.657699 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 296/556] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:12 2022] GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0 => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:12.936947 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-f106d77e-e7e2-41f2-9ee2-00c1e2c0b0da tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:12.938193 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-f106d77e-e7e2-41f2-9ee2-00c1e2c0b0da tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] [instance: dbc57534-e5bb-434a-a446-eb402deff943] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:12.949584 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f106d77e-e7e2-41f2-9ee2-00c1e2c0b0da tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:12.950368 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f106d77e-e7e2-41f2-9ee2-00c1e2c0b0da tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:12.951782 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f106d77e-e7e2-41f2-9ee2-00c1e2c0b0da tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:12.952505 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f106d77e-e7e2-41f2-9ee2-00c1e2c0b0da tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:12.976036 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.wsgi [None req-f106d77e-e7e2-41f2-9ee2-00c1e2c0b0da tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] HTTP exception thrown: Instance dbc57534-e5bb-434a-a446-eb402deff943 could not be found. Jul 29 05:25:12.977879 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-f106d77e-e7e2-41f2-9ee2-00c1e2c0b0da tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Request method failure captured: Jul 29 05:25:12.977879 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: request: GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943 HTTP/1.1 Jul 29 05:25:12.977879 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept: application/json Jul 29 05:25:12.977879 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept-Encoding: identity Jul 29 05:25:12.977879 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Connection: close Jul 29 05:25:12.977879 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Length: 0 Jul 29 05:25:12.977879 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Type: application/json Jul 29 05:25:12.977879 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Host: 10.222.0.49 Jul 29 05:25:12.977879 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Openstack-System-Scope: None Jul 29 05:25:12.977879 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: User-Agent: python-urllib3/1.26.10 Jul 29 05:25:12.977879 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Auth-Token: gAAAAABi42728gJ6PByW2mM82BOOwciKqw1i7pfyZbPY4MuaQxyGAipWgWZ0lQG46dWq-LEacwnQytrSQdmaAR3bKn3kirZ3oRrVhGo5umKBwwJeWQH-4orxAxU-A8mPZjverAQQumovE_PXI8_eFMTuVreQGexTQ_94eg46-mwk26tCDdMMbGQ Jul 29 05:25:12.977879 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Id: None Jul 29 05:25:12.977879 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Name: None Jul 29 05:25:12.977879 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Identity-Status: Confirmed Jul 29 05:25:12.977879 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Is-Admin-Project: True Jul 29 05:25:12.977879 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Id: default Jul 29 05:25:12.977879 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Name: Default Jul 29 05:25:12.977879 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Id: b28baf3f14f74766b11c9ee459b8d5ec Jul 29 05:25:12.977879 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Name: tempest-VolumesActionsTest-1877169005 Jul 29 05:25:12.977879 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Role: member,reader Jul 29 05:25:12.977879 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Roles: member,reader Jul 29 05:25:12.980404 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b28baf3f14f74766b11c9ee459b8d5ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b28baf3f14f74766b11c9ee459b8d5ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b28baf3f14f74766b11c9ee459b8d5ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b28baf3f14f74766b11c9ee459b8d5ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:25:12.980404 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant: tempest-VolumesActionsTest-1877169005 Jul 29 05:25:12.980404 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Id: b28baf3f14f74766b11c9ee459b8d5ec Jul 29 05:25:12.980404 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Name: tempest-VolumesActionsTest-1877169005 Jul 29 05:25:12.980404 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User: tempest-VolumesActionsTest-1877169005-project Jul 29 05:25:12.980404 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Id: default Jul 29 05:25:12.980404 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Name: Default Jul 29 05:25:12.980404 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Id: 27709d338705483b97997fcfd48d1d4a Jul 29 05:25:12.980404 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Name: tempest-VolumesActionsTest-1877169005-project Jul 29 05:25:12.980404 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: method: > Jul 29 05:25:12.980404 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: exception: Instance dbc57534-e5bb-434a-a446-eb402deff943 could not be found. Jul 29 05:25:12.980404 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: action_args: {'id': 'dbc57534-e5bb-434a-a446-eb402deff943'} Jul 29 05:25:12.986765 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:25:12.986765 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:25:12.986765 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:25:12.986765 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:25:12.986765 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:25:12.986765 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:25:12.986765 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:25:12.986765 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:25:12.986765 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:25:12.986765 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:25:12.986765 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbc57534-e5bb-434a-a446-eb402deff943 could not be found. Jul 29 05:25:12.986765 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:25:12.986765 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:25:12.986765 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:25:12.986765 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:25:12.986765 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:25:12.986765 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:25:12.986765 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:25:12.986765 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:25:12.986765 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:25:12.988578 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:25:12.988578 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:25:12.988578 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:25:12.988578 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:25:12.988578 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:25:12.988578 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:25:12.988578 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:25:12.988578 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbc57534-e5bb-434a-a446-eb402deff943 could not be found. Jul 29 05:25:12.988578 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:25:12.988578 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:25:12.988578 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:25:12.988578 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:25:12.988578 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:25:12.988578 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:25:12.988578 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:25:12.988578 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:25:12.988578 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbc57534-e5bb-434a-a446-eb402deff943 could not be found. Jul 29 05:25:12.988578 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:25:12.989865 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-f106d77e-e7e2-41f2-9ee2-00c1e2c0b0da tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] Returning 404 to user: Instance dbc57534-e5bb-434a-a446-eb402deff943 could not be found. {{(pid=117820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:25:12.989865 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-f106d77e-e7e2-41f2-9ee2-00c1e2c0b0da tempest-VolumesActionsTest-1877169005 tempest-VolumesActionsTest-1877169005-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943" status: 404 len: 111 microversion: 2.1 time: 0.047538 Jul 29 05:25:12.989865 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 261/557] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:12 2022] GET /compute/v2.1/servers/dbc57534-e5bb-434a-a446-eb402deff943 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 05:25:13.447494 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-383d5607-099e-4280-9d94-dc918f356b46 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:13.448224 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-383d5607-099e-4280-9d94-dc918f356b46 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:13.455857 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-383d5607-099e-4280-9d94-dc918f356b46 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:13.456852 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-383d5607-099e-4280-9d94-dc918f356b46 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:13.457663 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-383d5607-099e-4280-9d94-dc918f356b46 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:13.459263 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-383d5607-099e-4280-9d94-dc918f356b46 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:13.668360 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-4441e74f-9713-43dc-8c5c-e1a106ffe208 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:13.669989 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-4441e74f-9713-43dc-8c5c-e1a106ffe208 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:13.687891 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-4441e74f-9713-43dc-8c5c-e1a106ffe208 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:13.688683 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-4441e74f-9713-43dc-8c5c-e1a106ffe208 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:13.689762 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-4441e74f-9713-43dc-8c5c-e1a106ffe208 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:13.690315 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-4441e74f-9713-43dc-8c5c-e1a106ffe208 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:13.770733 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-383d5607-099e-4280-9d94-dc918f356b46 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:13.793666 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-383d5607-099e-4280-9d94-dc918f356b46 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1677 microversion: 2.1 time: 0.351544 Jul 29 05:25:13.795039 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 297/558] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:13 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1677 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:25:13.813999 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-5985d49f-5f2d-45f6-a2b8-276ecee3a32e tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:13.816886 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-5985d49f-5f2d-45f6-a2b8-276ecee3a32e tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 87501cee-ef3c-4bdb-942c-3fc67c1032d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:13.831176 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5985d49f-5f2d-45f6-a2b8-276ecee3a32e tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:13.831756 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5985d49f-5f2d-45f6-a2b8-276ecee3a32e tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:13.834977 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5985d49f-5f2d-45f6-a2b8-276ecee3a32e tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:13.835581 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5985d49f-5f2d-45f6-a2b8-276ecee3a32e tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:14.102408 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-5985d49f-5f2d-45f6-a2b8-276ecee3a32e tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:14.117023 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-5985d49f-5f2d-45f6-a2b8-276ecee3a32e tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0" status: 200 len: 1319 microversion: 2.1 time: 0.319889 Jul 29 05:25:14.118723 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 298/559] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:13 2022] GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0 => generated 1319 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:14.131213 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-42b05246-04d9-4a4d-8300-46cba0258ab4 req-db142f2e-628c-48dd-9430-5c65f714002a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87501cee-ef3c-4bdb-942c-3fc67c1032d0", "tag": "0cf03d4c-168e-46d0-b7d2-ec0918ad036b"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:25:14.156528 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-42b05246-04d9-4a4d-8300-46cba0258ab4 req-db142f2e-628c-48dd-9430-5c65f714002a service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:14.156755 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-42b05246-04d9-4a4d-8300-46cba0258ab4 req-db142f2e-628c-48dd-9430-5c65f714002a service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:14.179781 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-42b05246-04d9-4a4d-8300-46cba0258ab4 req-db142f2e-628c-48dd-9430-5c65f714002a service nova] Creating event network-changed:0cf03d4c-168e-46d0-b7d2-ec0918ad036b for instance 87501cee-ef3c-4bdb-942c-3fc67c1032d0 on hv-cinder-85127 Jul 29 05:25:14.185332 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-42b05246-04d9-4a4d-8300-46cba0258ab4 req-db142f2e-628c-48dd-9430-5c65f714002a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060701 Jul 29 05:25:14.186559 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 299/560] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:25:14.440689 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-4441e74f-9713-43dc-8c5c-e1a106ffe208 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:14.451555 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-4441e74f-9713-43dc-8c5c-e1a106ffe208 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1737 microversion: 2.1 time: 0.792050 Jul 29 05:25:14.452347 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 262/561] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:13 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1737 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:25:14.819368 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-4007a877-0501-42b2-8353-a5e04cb195a0 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:14.821351 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-4007a877-0501-42b2-8353-a5e04cb195a0 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:14.832214 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4007a877-0501-42b2-8353-a5e04cb195a0 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:14.832942 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4007a877-0501-42b2-8353-a5e04cb195a0 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:14.834791 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4007a877-0501-42b2-8353-a5e04cb195a0 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:14.835546 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4007a877-0501-42b2-8353-a5e04cb195a0 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:14.837221 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-2c276dd4-9160-4954-b8d6-21569c788272 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-535143613", "imageRef": "b7bf870d-4e7c-42fd-849f-72ac19277493", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b55efc63-6791-470d-af15-935a2f0fc83e"}], "security_groups": [{"name": "tempest-securitygroup--240831175"}], "key_name": "tempest-keypair-1673634664", "user_data": "}} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:25:14.940240 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell0:SELECT=2 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:25:14.976394 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.network.neutron [None req-2c276dd4-9160-4954-b8d6-21569c788272 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] validate_networks() for [('b55efc63-6791-470d-af15-935a2f0fc83e', None, None, None, None, None)] {{(pid=117820) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 05:25:15.027910 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-4007a877-0501-42b2-8353-a5e04cb195a0 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:15.042500 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-4007a877-0501-42b2-8353-a5e04cb195a0 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1677 microversion: 2.1 time: 0.229021 Jul 29 05:25:15.043604 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 300/562] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:14 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1677 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:15.156748 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-0b022bd9-a455-4d0a-abb3-be756b1f554b tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:15.157405 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-0b022bd9-a455-4d0a-abb3-be756b1f554b tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 87501cee-ef3c-4bdb-942c-3fc67c1032d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:15.164957 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0b022bd9-a455-4d0a-abb3-be756b1f554b tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:15.165419 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0b022bd9-a455-4d0a-abb3-be756b1f554b tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:15.166212 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0b022bd9-a455-4d0a-abb3-be756b1f554b tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:15.166654 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0b022bd9-a455-4d0a-abb3-be756b1f554b tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:15.245310 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell0:SELECT=2 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:25:15.338607 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-0b022bd9-a455-4d0a-abb3-be756b1f554b tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:15.352753 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-0b022bd9-a455-4d0a-abb3-be756b1f554b tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0" status: 200 len: 1319 microversion: 2.1 time: 0.200174 Jul 29 05:25:15.353367 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 301/563] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:15 2022] GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:25:15.465761 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-2c276dd4-9160-4954-b8d6-21569c788272 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Flavor limits 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 05:25:15.466288 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-2c276dd4-9160-4954-b8d6-21569c788272 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Image limits 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 05:25:15.466662 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-2c276dd4-9160-4954-b8d6-21569c788272 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Flavor pref 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 05:25:15.467073 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-2c276dd4-9160-4954-b8d6-21569c788272 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Image pref 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 05:25:15.467512 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-2c276dd4-9160-4954-b8d6-21569c788272 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 05:25:15.474089 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-189b52c6-206a-4a9f-b578-b876d13247f9 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:15.475026 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-189b52c6-206a-4a9f-b578-b876d13247f9 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:15.481117 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2c276dd4-9160-4954-b8d6-21569c788272 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:15.481448 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-189b52c6-206a-4a9f-b578-b876d13247f9 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:15.481883 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-189b52c6-206a-4a9f-b578-b876d13247f9 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:15.482345 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2c276dd4-9160-4954-b8d6-21569c788272 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:15.482668 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-189b52c6-206a-4a9f-b578-b876d13247f9 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:15.483112 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-189b52c6-206a-4a9f-b578-b876d13247f9 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:15.483617 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2c276dd4-9160-4954-b8d6-21569c788272 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:15.484278 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2c276dd4-9160-4954-b8d6-21569c788272 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:15.505949 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.quota [None req-2c276dd4-9160-4954-b8d6-21569c788272 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Getting quotas for project 9d8baaf2e23546ee8ed1de278617c7d2. Resources: {'instances', 'ram', 'cores'} {{(pid=117820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:25:15.512509 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.quota [None req-2c276dd4-9160-4954-b8d6-21569c788272 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Getting quotas for user 3c60b3a983f14f50b1b762a3954a1059 and project 9d8baaf2e23546ee8ed1de278617c7d2. Resources: {'instances', 'ram', 'cores'} {{(pid=117820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:25:15.530393 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-2c276dd4-9160-4954-b8d6-21569c788272 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Going to run 1 instances... {{(pid=117820) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 05:25:15.533078 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-2c276dd4-9160-4954-b8d6-21569c788272 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 4471f55c-7166-4321-b0ac-438ae8d3e5e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b7bf870d-4e7c-42fd-849f-72ac19277493',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117820) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 05:25:15.608574 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-2c276dd4-9160-4954-b8d6-21569c788272 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.779286 Jul 29 05:25:15.610114 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 263/564] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 05:25:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 05:25:15.629284 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-24e0b8a0-0b17-4a55-ae40-7dd544032ed4 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:15.632750 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-24e0b8a0-0b17-4a55-ae40-7dd544032ed4 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 4471f55c-7166-4321-b0ac-438ae8d3e5e2] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:15.670774 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-189b52c6-206a-4a9f-b578-b876d13247f9 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:15.681898 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-189b52c6-206a-4a9f-b578-b876d13247f9 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1737 microversion: 2.1 time: 0.212401 Jul 29 05:25:15.683393 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 302/565] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:15 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:25:15.731785 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-24e0b8a0-0b17-4a55-ae40-7dd544032ed4 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:15.744378 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-24e0b8a0-0b17-4a55-ae40-7dd544032ed4 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2" status: 200 len: 1241 microversion: 2.1 time: 0.126129 Jul 29 05:25:15.758339 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 264/566] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:15 2022] GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2 => generated 1241 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:16.064217 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-c81f442d-7527-4b9a-b2c4-94773a078164 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:16.064957 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-c81f442d-7527-4b9a-b2c4-94773a078164 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:16.073709 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c81f442d-7527-4b9a-b2c4-94773a078164 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:16.074158 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c81f442d-7527-4b9a-b2c4-94773a078164 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:16.075138 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c81f442d-7527-4b9a-b2c4-94773a078164 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:16.075847 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c81f442d-7527-4b9a-b2c4-94773a078164 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:16.225398 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-c81f442d-7527-4b9a-b2c4-94773a078164 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:16.233915 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-c81f442d-7527-4b9a-b2c4-94773a078164 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1677 microversion: 2.1 time: 0.173716 Jul 29 05:25:16.234491 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 303/567] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:16 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:16.375437 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-0e58819d-b0e5-4269-9d78-d4d29903f040 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:16.375957 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-0e58819d-b0e5-4269-9d78-d4d29903f040 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 87501cee-ef3c-4bdb-942c-3fc67c1032d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:16.383751 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0e58819d-b0e5-4269-9d78-d4d29903f040 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:16.384205 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0e58819d-b0e5-4269-9d78-d4d29903f040 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:16.384982 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0e58819d-b0e5-4269-9d78-d4d29903f040 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:16.385418 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0e58819d-b0e5-4269-9d78-d4d29903f040 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:16.530471 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-0e58819d-b0e5-4269-9d78-d4d29903f040 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:16.539410 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-0e58819d-b0e5-4269-9d78-d4d29903f040 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0" status: 200 len: 1319 microversion: 2.1 time: 0.167818 Jul 29 05:25:16.540006 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 265/568] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:16 2022] GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:16.704717 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-92d665b8-e7e1-4833-8a2b-68121635ef52 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:16.705330 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-92d665b8-e7e1-4833-8a2b-68121635ef52 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:16.712009 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-92d665b8-e7e1-4833-8a2b-68121635ef52 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:16.712461 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-92d665b8-e7e1-4833-8a2b-68121635ef52 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:16.713257 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-92d665b8-e7e1-4833-8a2b-68121635ef52 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:16.713685 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-92d665b8-e7e1-4833-8a2b-68121635ef52 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:16.765667 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-be02d5e7-2593-49a4-96ac-f42c5186673a tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:16.766287 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-be02d5e7-2593-49a4-96ac-f42c5186673a tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 4471f55c-7166-4321-b0ac-438ae8d3e5e2] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:16.773186 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-be02d5e7-2593-49a4-96ac-f42c5186673a tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:16.773629 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-be02d5e7-2593-49a4-96ac-f42c5186673a tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:16.774407 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-be02d5e7-2593-49a4-96ac-f42c5186673a tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:16.774842 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-be02d5e7-2593-49a4-96ac-f42c5186673a tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:16.839655 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-be02d5e7-2593-49a4-96ac-f42c5186673a tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:16.847920 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-be02d5e7-2593-49a4-96ac-f42c5186673a tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2" status: 200 len: 1245 microversion: 2.1 time: 0.086038 Jul 29 05:25:16.848548 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 266/569] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:16 2022] GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:25:16.859433 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-92d665b8-e7e1-4833-8a2b-68121635ef52 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:16.868410 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-92d665b8-e7e1-4833-8a2b-68121635ef52 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1737 microversion: 2.1 time: 0.167581 Jul 29 05:25:16.869014 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 304/570] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:16 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:17.256364 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-00387176-7d42-4547-9cfb-a2e2f4985623 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:17.256960 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-00387176-7d42-4547-9cfb-a2e2f4985623 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:17.263124 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-00387176-7d42-4547-9cfb-a2e2f4985623 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:17.263605 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-00387176-7d42-4547-9cfb-a2e2f4985623 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:17.264368 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-00387176-7d42-4547-9cfb-a2e2f4985623 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:17.264799 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-00387176-7d42-4547-9cfb-a2e2f4985623 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:17.396948 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-00387176-7d42-4547-9cfb-a2e2f4985623 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:17.404507 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-00387176-7d42-4547-9cfb-a2e2f4985623 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1677 microversion: 2.1 time: 0.152207 Jul 29 05:25:17.405078 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 267/571] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:17 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:17.559873 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-870bf80c-2233-4dfa-af31-20a7e5708cad tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:17.560459 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-870bf80c-2233-4dfa-af31-20a7e5708cad tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 87501cee-ef3c-4bdb-942c-3fc67c1032d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:17.566891 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-870bf80c-2233-4dfa-af31-20a7e5708cad tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:17.567458 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-870bf80c-2233-4dfa-af31-20a7e5708cad tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:17.568223 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-870bf80c-2233-4dfa-af31-20a7e5708cad tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:17.568655 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-870bf80c-2233-4dfa-af31-20a7e5708cad tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:17.701344 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-870bf80c-2233-4dfa-af31-20a7e5708cad tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:17.710158 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-870bf80c-2233-4dfa-af31-20a7e5708cad tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0" status: 200 len: 1319 microversion: 2.1 time: 0.154171 Jul 29 05:25:17.710736 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 305/572] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:17 2022] GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:17.870678 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-d687ee06-b86d-4afe-8db1-758bef6b9480 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:17.871226 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-d687ee06-b86d-4afe-8db1-758bef6b9480 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 4471f55c-7166-4321-b0ac-438ae8d3e5e2] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:17.877899 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d687ee06-b86d-4afe-8db1-758bef6b9480 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:17.878357 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d687ee06-b86d-4afe-8db1-758bef6b9480 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:17.879145 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d687ee06-b86d-4afe-8db1-758bef6b9480 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:17.880418 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d687ee06-b86d-4afe-8db1-758bef6b9480 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:17.891102 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-f8e50304-5ea0-4386-87ac-000aca751218 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:17.892066 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-f8e50304-5ea0-4386-87ac-000aca751218 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:17.899707 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f8e50304-5ea0-4386-87ac-000aca751218 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:17.900171 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f8e50304-5ea0-4386-87ac-000aca751218 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:17.900953 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f8e50304-5ea0-4386-87ac-000aca751218 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:17.901391 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f8e50304-5ea0-4386-87ac-000aca751218 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:17.951651 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-d687ee06-b86d-4afe-8db1-758bef6b9480 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:17.960537 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-d687ee06-b86d-4afe-8db1-758bef6b9480 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2" status: 200 len: 1245 microversion: 2.1 time: 0.093843 Jul 29 05:25:17.961304 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 268/573] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:17 2022] GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2 => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:25:18.041659 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-f8e50304-5ea0-4386-87ac-000aca751218 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:18.049546 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-f8e50304-5ea0-4386-87ac-000aca751218 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1737 microversion: 2.1 time: 0.162916 Jul 29 05:25:18.050119 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 306/574] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:17 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:25:18.431269 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-d0148e65-2597-48e2-b919-88d8f98741f5 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:18.431951 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-d0148e65-2597-48e2-b919-88d8f98741f5 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:18.443686 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d0148e65-2597-48e2-b919-88d8f98741f5 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:18.444402 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d0148e65-2597-48e2-b919-88d8f98741f5 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:18.445558 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d0148e65-2597-48e2-b919-88d8f98741f5 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:18.446008 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d0148e65-2597-48e2-b919-88d8f98741f5 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:18.711526 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-d0148e65-2597-48e2-b919-88d8f98741f5 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:18.722097 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-d0148e65-2597-48e2-b919-88d8f98741f5 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1654 microversion: 2.1 time: 0.294147 Jul 29 05:25:18.723768 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 269/575] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:18 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1654 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:18.735901 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-6b71b97b-a200-4c76-affb-2ffa76216ef3 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:18.737810 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-6b71b97b-a200-4c76-affb-2ffa76216ef3 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 87501cee-ef3c-4bdb-942c-3fc67c1032d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:18.759655 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-0cfeecc0-3871-40f3-b7cf-70ecab3fe028 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:25:18.760441 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6b71b97b-a200-4c76-affb-2ffa76216ef3 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:18.761196 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6b71b97b-a200-4c76-affb-2ffa76216ef3 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:18.762742 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6b71b97b-a200-4c76-affb-2ffa76216ef3 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:18.763462 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6b71b97b-a200-4c76-affb-2ffa76216ef3 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:18.773474 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0cfeecc0-3871-40f3-b7cf-70ecab3fe028 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:18.774647 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0cfeecc0-3871-40f3-b7cf-70ecab3fe028 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:18.823754 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-0cfeecc0-3871-40f3-b7cf-70ecab3fe028 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Going to try to start instance {{(pid=117820) start /opt/stack/nova/nova/compute/api.py:2732}} Jul 29 05:25:18.890019 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-0cfeecc0-3871-40f3-b7cf-70ecab3fe028 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "POST /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba/action" status: 202 len: 0 microversion: 2.1 time: 0.146785 Jul 29 05:25:18.892230 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 270/576] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Jul 29 05:25:18 2022] POST /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 05:25:18.900920 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-58c2f533-44c3-438d-ae28-125ec778554d tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:18.901914 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-58c2f533-44c3-438d-ae28-125ec778554d tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:18.909277 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-58c2f533-44c3-438d-ae28-125ec778554d tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:18.910041 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-58c2f533-44c3-438d-ae28-125ec778554d tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:18.910917 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-58c2f533-44c3-438d-ae28-125ec778554d tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:18.911573 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-58c2f533-44c3-438d-ae28-125ec778554d tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:18.953669 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-6b71b97b-a200-4c76-affb-2ffa76216ef3 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:18.999435 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-6b71b97b-a200-4c76-affb-2ffa76216ef3 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0" status: 200 len: 1319 microversion: 2.1 time: 0.271297 Jul 29 05:25:19.001312 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 307/577] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:18 2022] GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0 => generated 1319 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:19.032483 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-099a481a-33a0-49ce-b16e-c097e971e3d1 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:19.038251 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-099a481a-33a0-49ce-b16e-c097e971e3d1 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 4471f55c-7166-4321-b0ac-438ae8d3e5e2] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:19.058638 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-099a481a-33a0-49ce-b16e-c097e971e3d1 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:19.059538 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-099a481a-33a0-49ce-b16e-c097e971e3d1 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:19.061637 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-099a481a-33a0-49ce-b16e-c097e971e3d1 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:19.062937 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-099a481a-33a0-49ce-b16e-c097e971e3d1 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:19.205715 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-099a481a-33a0-49ce-b16e-c097e971e3d1 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:19.229243 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-099a481a-33a0-49ce-b16e-c097e971e3d1 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2" status: 200 len: 1293 microversion: 2.1 time: 0.225615 Jul 29 05:25:19.230294 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 308/578] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:19 2022] GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2 => generated 1293 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:19.260113 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-c32ea9ed-260b-42c5-9620-e604a773ad8f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:19.260663 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-c32ea9ed-260b-42c5-9620-e604a773ad8f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:19.289541 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c32ea9ed-260b-42c5-9620-e604a773ad8f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:19.291366 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c32ea9ed-260b-42c5-9620-e604a773ad8f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:19.293896 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c32ea9ed-260b-42c5-9620-e604a773ad8f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:19.295318 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c32ea9ed-260b-42c5-9620-e604a773ad8f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:19.519672 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-c32ea9ed-260b-42c5-9620-e604a773ad8f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:19.534209 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-c32ea9ed-260b-42c5-9620-e604a773ad8f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1737 microversion: 2.1 time: 0.288402 Jul 29 05:25:19.534825 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 309/579] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:19 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1737 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:19.621164 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-58c2f533-44c3-438d-ae28-125ec778554d tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:19.638740 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-58c2f533-44c3-438d-ae28-125ec778554d tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1663 microversion: 2.1 time: 0.741634 Jul 29 05:25:19.640571 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 271/580] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:18 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1663 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:25:20.028725 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-f66bb95f-4722-4252-bd74-8b9c92cda2ab tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:20.029491 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-f66bb95f-4722-4252-bd74-8b9c92cda2ab tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 87501cee-ef3c-4bdb-942c-3fc67c1032d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:20.050113 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f66bb95f-4722-4252-bd74-8b9c92cda2ab tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:20.050592 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f66bb95f-4722-4252-bd74-8b9c92cda2ab tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:20.052022 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f66bb95f-4722-4252-bd74-8b9c92cda2ab tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:20.052474 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f66bb95f-4722-4252-bd74-8b9c92cda2ab tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:20.262920 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-0d461e5b-b682-4490-9886-192d9fbe78d4 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:20.263591 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-0d461e5b-b682-4490-9886-192d9fbe78d4 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 4471f55c-7166-4321-b0ac-438ae8d3e5e2] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:20.273702 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0d461e5b-b682-4490-9886-192d9fbe78d4 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:20.274166 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0d461e5b-b682-4490-9886-192d9fbe78d4 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:20.274993 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0d461e5b-b682-4490-9886-192d9fbe78d4 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:20.276968 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-f66bb95f-4722-4252-bd74-8b9c92cda2ab tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:20.286497 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0d461e5b-b682-4490-9886-192d9fbe78d4 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:20.290375 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-f66bb95f-4722-4252-bd74-8b9c92cda2ab tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0" status: 200 len: 1319 microversion: 2.1 time: 0.266657 Jul 29 05:25:20.291264 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 310/581] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:20 2022] GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0 => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:20.327248 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:25:20.407037 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-0d461e5b-b682-4490-9886-192d9fbe78d4 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:20.424195 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-0d461e5b-b682-4490-9886-192d9fbe78d4 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2" status: 200 len: 1299 microversion: 2.1 time: 0.165396 Jul 29 05:25:20.435530 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 272/582] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:20 2022] GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2 => generated 1299 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:20.558613 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-8a2c80df-6eaa-45e0-b7d4-4bfaf7d7f84a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:20.559238 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-8a2c80df-6eaa-45e0-b7d4-4bfaf7d7f84a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:20.569983 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8a2c80df-6eaa-45e0-b7d4-4bfaf7d7f84a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:20.570439 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8a2c80df-6eaa-45e0-b7d4-4bfaf7d7f84a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:20.571247 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8a2c80df-6eaa-45e0-b7d4-4bfaf7d7f84a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:20.573930 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8a2c80df-6eaa-45e0-b7d4-4bfaf7d7f84a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:20.665848 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-c250c262-414f-4454-aa27-d5634ee272a3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:20.667677 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-c250c262-414f-4454-aa27-d5634ee272a3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:20.684239 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c250c262-414f-4454-aa27-d5634ee272a3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:20.684984 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c250c262-414f-4454-aa27-d5634ee272a3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:20.685981 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c250c262-414f-4454-aa27-d5634ee272a3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:20.704475 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c250c262-414f-4454-aa27-d5634ee272a3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:20.980199 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-8a2c80df-6eaa-45e0-b7d4-4bfaf7d7f84a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:21.024417 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-8a2c80df-6eaa-45e0-b7d4-4bfaf7d7f84a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1737 microversion: 2.1 time: 0.465323 Jul 29 05:25:21.045530 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 311/583] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:20 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1737 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:21.155407 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-c250c262-414f-4454-aa27-d5634ee272a3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:21.173070 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-c250c262-414f-4454-aa27-d5634ee272a3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1663 microversion: 2.1 time: 0.514070 Jul 29 05:25:21.174271 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 273/584] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:20 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1663 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:21.318999 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-7df65446-8f2b-45a5-be33-a6d144a8cee6 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:21.319922 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-7df65446-8f2b-45a5-be33-a6d144a8cee6 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 87501cee-ef3c-4bdb-942c-3fc67c1032d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:21.333947 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell0:SELECT=10 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:25:21.336443 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7df65446-8f2b-45a5-be33-a6d144a8cee6 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:21.336902 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7df65446-8f2b-45a5-be33-a6d144a8cee6 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:21.341940 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7df65446-8f2b-45a5-be33-a6d144a8cee6 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:21.343074 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7df65446-8f2b-45a5-be33-a6d144a8cee6 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:21.452786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-af0c08bb-bf24-4d23-ada6-113bd74bd284 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:21.454448 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-af0c08bb-bf24-4d23-ada6-113bd74bd284 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 4471f55c-7166-4321-b0ac-438ae8d3e5e2] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:21.465708 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-af0c08bb-bf24-4d23-ada6-113bd74bd284 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:21.466786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-af0c08bb-bf24-4d23-ada6-113bd74bd284 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:21.468027 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-af0c08bb-bf24-4d23-ada6-113bd74bd284 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:21.468776 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-af0c08bb-bf24-4d23-ada6-113bd74bd284 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:21.550369 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-7df65446-8f2b-45a5-be33-a6d144a8cee6 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:21.607446 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-7df65446-8f2b-45a5-be33-a6d144a8cee6 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0" status: 200 len: 1319 microversion: 2.1 time: 0.295364 Jul 29 05:25:21.623628 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 312/585] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:21 2022] GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0 => generated 1319 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:21.757122 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-af0c08bb-bf24-4d23-ada6-113bd74bd284 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:21.769722 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-af0c08bb-bf24-4d23-ada6-113bd74bd284 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2" status: 200 len: 1366 microversion: 2.1 time: 0.321590 Jul 29 05:25:21.783920 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 274/586] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:21 2022] GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2 => generated 1366 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:25:22.076832 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-0d77fa88-1d83-461f-b336-c38ae9b68d92 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:22.078329 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-0d77fa88-1d83-461f-b336-c38ae9b68d92 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:22.092528 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0d77fa88-1d83-461f-b336-c38ae9b68d92 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:22.093027 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0d77fa88-1d83-461f-b336-c38ae9b68d92 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:22.093939 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0d77fa88-1d83-461f-b336-c38ae9b68d92 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:22.094468 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0d77fa88-1d83-461f-b336-c38ae9b68d92 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:22.101005 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell1:SELECT=100 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:25:22.218992 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-0f0126d9-1a0f-4b64-85ae-ddad525fd416 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:22.229756 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-0f0126d9-1a0f-4b64-85ae-ddad525fd416 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:22.243397 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0f0126d9-1a0f-4b64-85ae-ddad525fd416 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:22.243853 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0f0126d9-1a0f-4b64-85ae-ddad525fd416 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:22.251499 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0f0126d9-1a0f-4b64-85ae-ddad525fd416 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:22.252307 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0f0126d9-1a0f-4b64-85ae-ddad525fd416 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:22.330784 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-0d77fa88-1d83-461f-b336-c38ae9b68d92 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:22.343339 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-0d77fa88-1d83-461f-b336-c38ae9b68d92 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1737 microversion: 2.1 time: 0.270489 Jul 29 05:25:22.344774 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 313/587] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:22 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1737 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:22.364496 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-ba3a5ed9-c9ff-4de5-929b-8e1b460c9965 req-a8136d09-743d-4133-9461-308372f40311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87501cee-ef3c-4bdb-942c-3fc67c1032d0", "name": "network-vif-plugged", "status": "completed", "tag": "0cf03d4c-168e-46d0-b7d2-ec0918ad036b"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:25:22.378470 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-ba3a5ed9-c9ff-4de5-929b-8e1b460c9965 req-a8136d09-743d-4133-9461-308372f40311 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:22.380134 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-ba3a5ed9-c9ff-4de5-929b-8e1b460c9965 req-a8136d09-743d-4133-9461-308372f40311 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:22.394497 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-ba3a5ed9-c9ff-4de5-929b-8e1b460c9965 req-a8136d09-743d-4133-9461-308372f40311 service nova] Creating event network-vif-plugged:0cf03d4c-168e-46d0-b7d2-ec0918ad036b for instance 87501cee-ef3c-4bdb-942c-3fc67c1032d0 on hv-cinder-85127 Jul 29 05:25:22.402096 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-ba3a5ed9-c9ff-4de5-929b-8e1b460c9965 req-a8136d09-743d-4133-9461-308372f40311 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043971 Jul 29 05:25:22.403591 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 314/588] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:25:22.624016 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-0f0126d9-1a0f-4b64-85ae-ddad525fd416 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:22.633314 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-0f0126d9-1a0f-4b64-85ae-ddad525fd416 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1663 microversion: 2.1 time: 0.437575 Jul 29 05:25:22.634619 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 275/589] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:22 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1663 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:22.642099 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-0d4bdb6a-e51e-4cad-b20d-c0b47e68984b tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:22.642802 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-0d4bdb6a-e51e-4cad-b20d-c0b47e68984b tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 87501cee-ef3c-4bdb-942c-3fc67c1032d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:22.656832 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0d4bdb6a-e51e-4cad-b20d-c0b47e68984b tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:22.657146 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0d4bdb6a-e51e-4cad-b20d-c0b47e68984b tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:22.658394 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0d4bdb6a-e51e-4cad-b20d-c0b47e68984b tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:22.658602 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0d4bdb6a-e51e-4cad-b20d-c0b47e68984b tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:22.792676 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-672e6a9d-3f28-49b5-80bb-ff7f90802b09 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:22.793574 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-672e6a9d-3f28-49b5-80bb-ff7f90802b09 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 4471f55c-7166-4321-b0ac-438ae8d3e5e2] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:22.823016 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-672e6a9d-3f28-49b5-80bb-ff7f90802b09 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:22.823670 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-672e6a9d-3f28-49b5-80bb-ff7f90802b09 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:22.824640 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-672e6a9d-3f28-49b5-80bb-ff7f90802b09 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:22.825233 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-672e6a9d-3f28-49b5-80bb-ff7f90802b09 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:22.869964 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-0d4bdb6a-e51e-4cad-b20d-c0b47e68984b tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:22.878824 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-0d4bdb6a-e51e-4cad-b20d-c0b47e68984b tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0" status: 200 len: 1319 microversion: 2.1 time: 0.240761 Jul 29 05:25:22.892181 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 315/590] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:22 2022] GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0 => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:23.171612 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-672e6a9d-3f28-49b5-80bb-ff7f90802b09 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:23.187497 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-672e6a9d-3f28-49b5-80bb-ff7f90802b09 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2" status: 200 len: 1366 microversion: 2.1 time: 0.398766 Jul 29 05:25:23.188248 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 276/591] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:22 2022] GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2 => generated 1366 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:23.369906 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-58d0bd2d-6104-41c0-a749-123d1cc0beac tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:23.371901 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-58d0bd2d-6104-41c0-a749-123d1cc0beac tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:23.380384 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-58d0bd2d-6104-41c0-a749-123d1cc0beac tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:23.382125 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-58d0bd2d-6104-41c0-a749-123d1cc0beac tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:23.383580 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-58d0bd2d-6104-41c0-a749-123d1cc0beac tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:23.384326 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-58d0bd2d-6104-41c0-a749-123d1cc0beac tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:23.633034 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-58d0bd2d-6104-41c0-a749-123d1cc0beac tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:23.642589 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-58d0bd2d-6104-41c0-a749-123d1cc0beac tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1737 microversion: 2.1 time: 0.277047 Jul 29 05:25:23.643199 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 316/592] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:23 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1737 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:23.663775 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-dd6400e4-d8b6-4e89-88d8-e75e9a6beb73 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:23.664994 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-dd6400e4-d8b6-4e89-88d8-e75e9a6beb73 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:23.673536 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-dd6400e4-d8b6-4e89-88d8-e75e9a6beb73 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:23.674233 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-dd6400e4-d8b6-4e89-88d8-e75e9a6beb73 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:23.675151 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-dd6400e4-d8b6-4e89-88d8-e75e9a6beb73 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:23.675693 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-dd6400e4-d8b6-4e89-88d8-e75e9a6beb73 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:23.852876 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-01e71625-ec2a-49d4-933b-047f8ea10cda req-b43267d1-4ed9-41f6-ba8d-37769e5efd36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4471f55c-7166-4321-b0ac-438ae8d3e5e2", "tag": "cc0ff66d-f4e0-423a-a8ff-dc678b54c231"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:25:23.916373 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-01e71625-ec2a-49d4-933b-047f8ea10cda req-b43267d1-4ed9-41f6-ba8d-37769e5efd36 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:23.917190 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-01e71625-ec2a-49d4-933b-047f8ea10cda req-b43267d1-4ed9-41f6-ba8d-37769e5efd36 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:23.932413 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-01e71625-ec2a-49d4-933b-047f8ea10cda req-b43267d1-4ed9-41f6-ba8d-37769e5efd36 service nova] Creating event network-changed:cc0ff66d-f4e0-423a-a8ff-dc678b54c231 for instance 4471f55c-7166-4321-b0ac-438ae8d3e5e2 on hv-cinder-85127 Jul 29 05:25:23.938910 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-01e71625-ec2a-49d4-933b-047f8ea10cda req-b43267d1-4ed9-41f6-ba8d-37769e5efd36 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099616 Jul 29 05:25:23.940015 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 317/593] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:25:23.947982 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-9fd48d41-5814-44f6-a82b-6f2770191d03 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:23.949252 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-9fd48d41-5814-44f6-a82b-6f2770191d03 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 87501cee-ef3c-4bdb-942c-3fc67c1032d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:23.963797 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9fd48d41-5814-44f6-a82b-6f2770191d03 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:23.964832 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9fd48d41-5814-44f6-a82b-6f2770191d03 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:23.966099 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9fd48d41-5814-44f6-a82b-6f2770191d03 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:23.967179 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9fd48d41-5814-44f6-a82b-6f2770191d03 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:24.054871 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-dd6400e4-d8b6-4e89-88d8-e75e9a6beb73 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:24.065581 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-dd6400e4-d8b6-4e89-88d8-e75e9a6beb73 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1667 microversion: 2.1 time: 0.411079 Jul 29 05:25:24.081869 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 277/594] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:23 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1667 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:24.184577 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-9fd48d41-5814-44f6-a82b-6f2770191d03 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:24.192590 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-9fd48d41-5814-44f6-a82b-6f2770191d03 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0" status: 200 len: 1319 microversion: 2.1 time: 0.250911 Jul 29 05:25:24.193452 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 318/595] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:23 2022] GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:24.219950 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-a00a7466-276c-4586-bc91-f8fc945ef7ae tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:24.220569 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-a00a7466-276c-4586-bc91-f8fc945ef7ae tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 4471f55c-7166-4321-b0ac-438ae8d3e5e2] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:24.227681 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a00a7466-276c-4586-bc91-f8fc945ef7ae tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:24.228393 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a00a7466-276c-4586-bc91-f8fc945ef7ae tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:24.229350 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a00a7466-276c-4586-bc91-f8fc945ef7ae tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:24.229966 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a00a7466-276c-4586-bc91-f8fc945ef7ae tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:24.428624 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-a00a7466-276c-4586-bc91-f8fc945ef7ae tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:24.437821 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-a00a7466-276c-4586-bc91-f8fc945ef7ae tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2" status: 200 len: 1366 microversion: 2.1 time: 0.230549 Jul 29 05:25:24.438417 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 278/596] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:24 2022] GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:24.667768 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-4a01a499-b2ae-4fa5-b0ae-4e0cf0e540be tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:24.668607 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-4a01a499-b2ae-4fa5-b0ae-4e0cf0e540be tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:24.677220 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4a01a499-b2ae-4fa5-b0ae-4e0cf0e540be tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:24.677802 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4a01a499-b2ae-4fa5-b0ae-4e0cf0e540be tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:24.679014 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4a01a499-b2ae-4fa5-b0ae-4e0cf0e540be tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:24.680249 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4a01a499-b2ae-4fa5-b0ae-4e0cf0e540be tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:24.867204 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-4a01a499-b2ae-4fa5-b0ae-4e0cf0e540be tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:24.883818 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-4a01a499-b2ae-4fa5-b0ae-4e0cf0e540be tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1737 microversion: 2.1 time: 0.220829 Jul 29 05:25:24.884533 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 319/597] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:24 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1737 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:25.225917 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-a47dcfda-5efd-46af-ae47-3d362d70ef54 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:25.226760 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-a47dcfda-5efd-46af-ae47-3d362d70ef54 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 87501cee-ef3c-4bdb-942c-3fc67c1032d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:25.234576 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a47dcfda-5efd-46af-ae47-3d362d70ef54 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:25.235476 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a47dcfda-5efd-46af-ae47-3d362d70ef54 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:25.236527 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a47dcfda-5efd-46af-ae47-3d362d70ef54 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:25.237032 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a47dcfda-5efd-46af-ae47-3d362d70ef54 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:25.414890 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-a47dcfda-5efd-46af-ae47-3d362d70ef54 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:25.423740 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-a47dcfda-5efd-46af-ae47-3d362d70ef54 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0" status: 200 len: 1507 microversion: 2.1 time: 0.203709 Jul 29 05:25:25.424344 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 279/598] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:25 2022] GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0 => generated 1507 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:25.448689 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-9bdbcf1e-0e2e-439d-bc9b-c546cfb22247 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "faa3f728-d929-412b-aedf-62871236c694", "device": "/dev/sdb"}} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:25:25.451303 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-9bdbcf1e-0e2e-439d-bc9b-c546cfb22247 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 87501cee-ef3c-4bdb-942c-3fc67c1032d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:25.459222 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9bdbcf1e-0e2e-439d-bc9b-c546cfb22247 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:25.459706 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9bdbcf1e-0e2e-439d-bc9b-c546cfb22247 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:25.460161 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-076024d0-209f-4c34-9e04-dd6533ae90d1 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:25.460570 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9bdbcf1e-0e2e-439d-bc9b-c546cfb22247 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:25.460775 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-076024d0-209f-4c34-9e04-dd6533ae90d1 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 4471f55c-7166-4321-b0ac-438ae8d3e5e2] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:25.461011 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9bdbcf1e-0e2e-439d-bc9b-c546cfb22247 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:25.468170 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-076024d0-209f-4c34-9e04-dd6533ae90d1 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:25.468619 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-076024d0-209f-4c34-9e04-dd6533ae90d1 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:25.469391 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-076024d0-209f-4c34-9e04-dd6533ae90d1 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:25.469826 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-076024d0-209f-4c34-9e04-dd6533ae90d1 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:25.497722 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell0:SELECT=2 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:25:25.655330 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-076024d0-209f-4c34-9e04-dd6533ae90d1 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:25.667960 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-076024d0-209f-4c34-9e04-dd6533ae90d1 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2" status: 200 len: 1366 microversion: 2.1 time: 0.211937 Jul 29 05:25:25.668781 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 280/599] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:25 2022] GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:25:25.909740 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-cd123fce-582e-4522-9938-6f5df12862fc tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:25.912114 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-cd123fce-582e-4522-9938-6f5df12862fc tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:25.914040 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell0:SELECT=8 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:25:25.920108 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-cd123fce-582e-4522-9938-6f5df12862fc tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:25.920588 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-cd123fce-582e-4522-9938-6f5df12862fc tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:25.921384 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-cd123fce-582e-4522-9938-6f5df12862fc tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:25.921986 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-cd123fce-582e-4522-9938-6f5df12862fc tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:26.107661 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-cd123fce-582e-4522-9938-6f5df12862fc tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:26.116468 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-cd123fce-582e-4522-9938-6f5df12862fc tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1737 microversion: 2.1 time: 0.210460 Jul 29 05:25:26.117415 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 281/600] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:25 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:26.386434 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-9bdbcf1e-0e2e-439d-bc9b-c546cfb22247 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "POST /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.941794 Jul 29 05:25:26.389275 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 320/601] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Jul 29 05:25:25 2022] POST /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0/os-volume_attachments => generated 194 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:25:26.691614 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-f21db025-108d-4a33-b295-2bbcf17de76d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:26.693049 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-f21db025-108d-4a33-b295-2bbcf17de76d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 4471f55c-7166-4321-b0ac-438ae8d3e5e2] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:26.701687 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f21db025-108d-4a33-b295-2bbcf17de76d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:26.703035 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f21db025-108d-4a33-b295-2bbcf17de76d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:26.705479 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f21db025-108d-4a33-b295-2bbcf17de76d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:26.706276 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f21db025-108d-4a33-b295-2bbcf17de76d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:26.983667 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-f21db025-108d-4a33-b295-2bbcf17de76d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:26.995878 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-f21db025-108d-4a33-b295-2bbcf17de76d tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2" status: 200 len: 1366 microversion: 2.1 time: 0.309110 Jul 29 05:25:26.996807 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 282/602] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:26 2022] GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2 => generated 1366 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:25:27.144523 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-3b8aa3f9-4e34-49ac-b964-415182c91690 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:27.145823 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-3b8aa3f9-4e34-49ac-b964-415182c91690 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:27.153138 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3b8aa3f9-4e34-49ac-b964-415182c91690 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:27.153940 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3b8aa3f9-4e34-49ac-b964-415182c91690 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:27.154982 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3b8aa3f9-4e34-49ac-b964-415182c91690 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:27.155890 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3b8aa3f9-4e34-49ac-b964-415182c91690 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:27.335903 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-3b8aa3f9-4e34-49ac-b964-415182c91690 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:27.348507 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-3b8aa3f9-4e34-49ac-b964-415182c91690 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1737 microversion: 2.1 time: 0.208771 Jul 29 05:25:27.351218 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 321/603] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:27 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:28.018486 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-6815e7ca-d8f4-4d83-8f58-4fac1d5a90e9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:28.019226 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-6815e7ca-d8f4-4d83-8f58-4fac1d5a90e9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 4471f55c-7166-4321-b0ac-438ae8d3e5e2] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:28.027503 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6815e7ca-d8f4-4d83-8f58-4fac1d5a90e9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:28.028731 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6815e7ca-d8f4-4d83-8f58-4fac1d5a90e9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:28.028731 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6815e7ca-d8f4-4d83-8f58-4fac1d5a90e9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:28.029025 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6815e7ca-d8f4-4d83-8f58-4fac1d5a90e9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:28.193764 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-6815e7ca-d8f4-4d83-8f58-4fac1d5a90e9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:28.202962 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-6815e7ca-d8f4-4d83-8f58-4fac1d5a90e9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2" status: 200 len: 1366 microversion: 2.1 time: 0.188538 Jul 29 05:25:28.215456 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 283/604] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:28 2022] GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:28.385428 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-213a4c11-b49b-489f-bd0e-086b6efe5de3 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:28.386654 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-213a4c11-b49b-489f-bd0e-086b6efe5de3 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:28.404332 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-213a4c11-b49b-489f-bd0e-086b6efe5de3 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:28.404800 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-213a4c11-b49b-489f-bd0e-086b6efe5de3 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:28.405864 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-213a4c11-b49b-489f-bd0e-086b6efe5de3 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:28.406300 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-213a4c11-b49b-489f-bd0e-086b6efe5de3 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:28.598202 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-213a4c11-b49b-489f-bd0e-086b6efe5de3 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:28.612611 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-213a4c11-b49b-489f-bd0e-086b6efe5de3 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1737 microversion: 2.1 time: 0.237613 Jul 29 05:25:28.618109 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 322/605] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:28 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1737 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:29.226928 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-2758a0e3-5bc0-413b-b54d-21add75bdfd2 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:29.229138 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-2758a0e3-5bc0-413b-b54d-21add75bdfd2 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 4471f55c-7166-4321-b0ac-438ae8d3e5e2] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:29.236896 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2758a0e3-5bc0-413b-b54d-21add75bdfd2 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:29.237351 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2758a0e3-5bc0-413b-b54d-21add75bdfd2 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:29.238618 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2758a0e3-5bc0-413b-b54d-21add75bdfd2 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:29.239255 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2758a0e3-5bc0-413b-b54d-21add75bdfd2 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:29.415078 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-2758a0e3-5bc0-413b-b54d-21add75bdfd2 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:29.423728 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-2758a0e3-5bc0-413b-b54d-21add75bdfd2 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2" status: 200 len: 1366 microversion: 2.1 time: 0.200958 Jul 29 05:25:29.438046 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 284/606] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:29 2022] GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:29.652050 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-234e724d-27d0-4f93-a8aa-3defd5950407 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:29.653379 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-234e724d-27d0-4f93-a8aa-3defd5950407 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:29.661473 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-234e724d-27d0-4f93-a8aa-3defd5950407 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:29.662212 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-234e724d-27d0-4f93-a8aa-3defd5950407 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:29.663265 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-234e724d-27d0-4f93-a8aa-3defd5950407 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:29.663924 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-234e724d-27d0-4f93-a8aa-3defd5950407 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:29.833918 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-234e724d-27d0-4f93-a8aa-3defd5950407 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:29.842683 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-234e724d-27d0-4f93-a8aa-3defd5950407 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1737 microversion: 2.1 time: 0.194649 Jul 29 05:25:29.843250 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 323/607] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:29 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1737 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:30.209212 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-c76c2a13-d23d-499e-b920-733a415747cb req-7124cf47-816e-4e59-9486-b9e9d5c8c7b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4471f55c-7166-4321-b0ac-438ae8d3e5e2", "name": "network-vif-plugged", "status": "completed", "tag": "cc0ff66d-f4e0-423a-a8ff-dc678b54c231"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:25:30.226680 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-c76c2a13-d23d-499e-b920-733a415747cb req-7124cf47-816e-4e59-9486-b9e9d5c8c7b0 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:30.227459 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-c76c2a13-d23d-499e-b920-733a415747cb req-7124cf47-816e-4e59-9486-b9e9d5c8c7b0 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:30.241774 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-c76c2a13-d23d-499e-b920-733a415747cb req-7124cf47-816e-4e59-9486-b9e9d5c8c7b0 service nova] Creating event network-vif-plugged:cc0ff66d-f4e0-423a-a8ff-dc678b54c231 for instance 4471f55c-7166-4321-b0ac-438ae8d3e5e2 on hv-cinder-85127 Jul 29 05:25:30.255648 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-c76c2a13-d23d-499e-b920-733a415747cb req-7124cf47-816e-4e59-9486-b9e9d5c8c7b0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050172 Jul 29 05:25:30.257298 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 285/608] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:25:30.448938 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-ac742cc6-6e9c-44e5-8cc4-9c6e8f0e3368 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:30.449492 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-ac742cc6-6e9c-44e5-8cc4-9c6e8f0e3368 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 4471f55c-7166-4321-b0ac-438ae8d3e5e2] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:30.456465 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ac742cc6-6e9c-44e5-8cc4-9c6e8f0e3368 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:30.457136 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ac742cc6-6e9c-44e5-8cc4-9c6e8f0e3368 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:30.458047 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ac742cc6-6e9c-44e5-8cc4-9c6e8f0e3368 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:30.458481 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ac742cc6-6e9c-44e5-8cc4-9c6e8f0e3368 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:30.628630 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-ac742cc6-6e9c-44e5-8cc4-9c6e8f0e3368 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:30.638761 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-ac742cc6-6e9c-44e5-8cc4-9c6e8f0e3368 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2" status: 200 len: 1366 microversion: 2.1 time: 0.197264 Jul 29 05:25:30.653059 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 324/609] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:30 2022] GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2 => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:30.864700 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-fd423898-ee83-44f0-a781-423130e55981 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:30.865252 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-fd423898-ee83-44f0-a781-423130e55981 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:30.881368 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-fd423898-ee83-44f0-a781-423130e55981 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:30.882096 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-fd423898-ee83-44f0-a781-423130e55981 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:30.883118 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-fd423898-ee83-44f0-a781-423130e55981 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:30.883752 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-fd423898-ee83-44f0-a781-423130e55981 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:31.045987 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-fd423898-ee83-44f0-a781-423130e55981 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:31.061561 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-fd423898-ee83-44f0-a781-423130e55981 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1717 microversion: 2.1 time: 0.201191 Jul 29 05:25:31.062491 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 286/610] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:30 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1717 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:31.204024 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-2ec9bf45-c5bf-41ea-ac3c-7b881a21ef81 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:31.204720 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-2ec9bf45-c5bf-41ea-ac3c-7b881a21ef81 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:31.212843 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2ec9bf45-c5bf-41ea-ac3c-7b881a21ef81 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:31.213329 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2ec9bf45-c5bf-41ea-ac3c-7b881a21ef81 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:31.214129 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2ec9bf45-c5bf-41ea-ac3c-7b881a21ef81 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:31.214570 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2ec9bf45-c5bf-41ea-ac3c-7b881a21ef81 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:31.373914 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.wsgi [None req-2ec9bf45-c5bf-41ea-ac3c-7b881a21ef81 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] HTTP exception thrown: Cannot 'detach_volume' instance 00171c99-cf39-4ed6-b78a-3bb24272b171 while it is in vm_state rescued Jul 29 05:25:31.375995 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-2ec9bf45-c5bf-41ea-ac3c-7b881a21ef81 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Request method failure captured: Jul 29 05:25:31.375995 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: request: DELETE /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171/os-volume_attachments/596e7484-d6fd-4d29-b72b-02ba35278ef9 HTTP/1.1 Jul 29 05:25:31.375995 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept: application/json Jul 29 05:25:31.375995 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept-Encoding: identity Jul 29 05:25:31.375995 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Connection: close Jul 29 05:25:31.375995 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Length: 0 Jul 29 05:25:31.375995 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Type: application/json Jul 29 05:25:31.375995 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Host: 10.222.0.49 Jul 29 05:25:31.375995 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Openstack-System-Scope: None Jul 29 05:25:31.375995 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: User-Agent: python-urllib3/1.26.10 Jul 29 05:25:31.375995 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Auth-Token: gAAAAABi425NDze3MZ6r1VD0FCYdq0OmQOLp-a8UlwTMNu4OjL5RkBuPvg1CcwPwgOttOt-6wL5UPCvTmDT4dvtmSR2MiB9UhU4F3cFaVbG964PhwtxReJ17pRKIo-RqoKvGgdruft6DgwjaYgOO11XCIKmUEetc8GovjBVxuznVeh-B9PpnvOw Jul 29 05:25:31.375995 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Id: None Jul 29 05:25:31.375995 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Name: None Jul 29 05:25:31.375995 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Identity-Status: Confirmed Jul 29 05:25:31.375995 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Is-Admin-Project: True Jul 29 05:25:31.375995 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Id: default Jul 29 05:25:31.375995 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Name: Default Jul 29 05:25:31.375995 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Id: 153fe5d9d64346f6b7419eba91948678 Jul 29 05:25:31.375995 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1077257590 Jul 29 05:25:31.375995 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Role: member,reader Jul 29 05:25:31.375995 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Roles: member,reader Jul 29 05:25:31.377487 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/153fe5d9d64346f6b7419eba91948678"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/153fe5d9d64346f6b7419eba91948678"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_153fe5d9d64346f6b7419eba91948678"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/153fe5d9d64346f6b7419eba91948678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:25:31.377487 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1077257590 Jul 29 05:25:31.377487 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Id: 153fe5d9d64346f6b7419eba91948678 Jul 29 05:25:31.377487 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1077257590 Jul 29 05:25:31.377487 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User: tempest-ServerRescueNegativeTestJSON-1077257590-project Jul 29 05:25:31.377487 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Id: default Jul 29 05:25:31.377487 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Name: Default Jul 29 05:25:31.377487 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Id: 45ae88234e984149be8539757efa8733 Jul 29 05:25:31.377487 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1077257590-project Jul 29 05:25:31.377487 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: method: > Jul 29 05:25:31.377487 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: exception: Cannot 'detach_volume' instance 00171c99-cf39-4ed6-b78a-3bb24272b171 while it is in vm_state rescued Jul 29 05:25:31.378276 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: action_args: {'server_id': '00171c99-cf39-4ed6-b78a-3bb24272b171', 'id': '596e7484-d6fd-4d29-b72b-02ba35278ef9'} Jul 29 05:25:31.378276 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:25:31.378276 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:25:31.378276 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 29 05:25:31.378276 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 29 05:25:31.378276 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 29 05:25:31.378276 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 29 05:25:31.378276 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 29 05:25:31.378276 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 29 05:25:31.378276 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 00171c99-cf39-4ed6-b78a-3bb24272b171 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 29 05:25:31.378276 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:25:31.378276 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:25:31.378276 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:25:31.378276 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:25:31.378276 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:25:31.378276 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:25:31.378276 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:25:31.378276 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:25:31.378276 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:25:31.378276 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:25:31.380166 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 29 05:25:31.380166 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 29 05:25:31.380166 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 29 05:25:31.380166 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 29 05:25:31.380166 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 00171c99-cf39-4ed6-b78a-3bb24272b171 while it is in vm_state rescued Jul 29 05:25:31.380166 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:25:31.380166 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:25:31.380166 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:25:31.380166 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:25:31.380166 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:25:31.380166 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:25:31.380166 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:25:31.380166 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:25:31.380166 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 00171c99-cf39-4ed6-b78a-3bb24272b171 while it is in vm_state rescued Jul 29 05:25:31.380166 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:25:31.380166 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-2ec9bf45-c5bf-41ea-ac3c-7b881a21ef81 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Returning 409 to user: Cannot 'detach_volume' instance 00171c99-cf39-4ed6-b78a-3bb24272b171 while it is in vm_state rescued {{(pid=117821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:25:31.381104 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-2ec9bf45-c5bf-41ea-ac3c-7b881a21ef81 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "DELETE /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171/os-volume_attachments/596e7484-d6fd-4d29-b72b-02ba35278ef9" status: 409 len: 152 microversion: 2.1 time: 0.177932 Jul 29 05:25:31.381104 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 325/611] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Jul 29 05:25:31 2022] DELETE /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171/os-volume_attachments/596e7484-d6fd-4d29-b72b-02ba35278ef9 => generated 152 bytes in 179 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 29 05:25:31.387683 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-e349f924-2295-437a-8836-19e2be2659de tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:25:31.388394 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-e349f924-2295-437a-8836-19e2be2659de tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:31.395250 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e349f924-2295-437a-8836-19e2be2659de tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:31.396094 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e349f924-2295-437a-8836-19e2be2659de tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:31.397200 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e349f924-2295-437a-8836-19e2be2659de tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:31.397862 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e349f924-2295-437a-8836-19e2be2659de tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:31.482592 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-e349f924-2295-437a-8836-19e2be2659de tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "POST /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171/action" status: 202 len: 0 microversion: 2.1 time: 0.098955 Jul 29 05:25:31.486681 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 287/612] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Jul 29 05:25:31 2022] POST /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 05:25:31.493223 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-1b1d6ff7-87ca-41c5-961b-fc516cff10c8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:31.494108 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-1b1d6ff7-87ca-41c5-961b-fc516cff10c8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:31.501442 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1b1d6ff7-87ca-41c5-961b-fc516cff10c8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:31.501922 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1b1d6ff7-87ca-41c5-961b-fc516cff10c8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:31.502712 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1b1d6ff7-87ca-41c5-961b-fc516cff10c8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:31.503149 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1b1d6ff7-87ca-41c5-961b-fc516cff10c8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:31.663300 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-934867de-b2af-4ad1-b58a-1fbec97b7668 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:31.664197 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-934867de-b2af-4ad1-b58a-1fbec97b7668 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 4471f55c-7166-4321-b0ac-438ae8d3e5e2] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:31.677390 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-934867de-b2af-4ad1-b58a-1fbec97b7668 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:31.678409 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-934867de-b2af-4ad1-b58a-1fbec97b7668 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:31.679732 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-934867de-b2af-4ad1-b58a-1fbec97b7668 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:31.680616 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-934867de-b2af-4ad1-b58a-1fbec97b7668 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:31.709100 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-1b1d6ff7-87ca-41c5-961b-fc516cff10c8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:31.717853 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:25:31.718763 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-1b1d6ff7-87ca-41c5-961b-fc516cff10c8 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1725 microversion: 2.1 time: 0.229913 Jul 29 05:25:31.719865 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 326/613] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:31 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1725 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:31.956375 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-934867de-b2af-4ad1-b58a-1fbec97b7668 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:31.968370 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-934867de-b2af-4ad1-b58a-1fbec97b7668 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2" status: 200 len: 1366 microversion: 2.1 time: 0.310543 Jul 29 05:25:31.970832 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 288/614] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:31 2022] GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2 => generated 1366 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:32.741871 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-5e0f4cb9-c1d5-4e34-bc2d-338e2ee5887b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:32.742686 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-5e0f4cb9-c1d5-4e34-bc2d-338e2ee5887b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:32.750750 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5e0f4cb9-c1d5-4e34-bc2d-338e2ee5887b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:32.751238 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5e0f4cb9-c1d5-4e34-bc2d-338e2ee5887b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:32.753364 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5e0f4cb9-c1d5-4e34-bc2d-338e2ee5887b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:32.754810 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5e0f4cb9-c1d5-4e34-bc2d-338e2ee5887b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:32.936225 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-5e0f4cb9-c1d5-4e34-bc2d-338e2ee5887b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:32.945430 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-5e0f4cb9-c1d5-4e34-bc2d-338e2ee5887b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1725 microversion: 2.1 time: 0.208378 Jul 29 05:25:32.946224 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 327/615] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:32 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1725 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:25:32.991236 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-2617d19d-d9fb-47a1-8da3-8b4c7ea111cc tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:32.991969 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-2617d19d-d9fb-47a1-8da3-8b4c7ea111cc tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 4471f55c-7166-4321-b0ac-438ae8d3e5e2] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:33.002897 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2617d19d-d9fb-47a1-8da3-8b4c7ea111cc tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:33.004380 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2617d19d-d9fb-47a1-8da3-8b4c7ea111cc tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:33.005516 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2617d19d-d9fb-47a1-8da3-8b4c7ea111cc tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:33.008030 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2617d19d-d9fb-47a1-8da3-8b4c7ea111cc tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:33.169618 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-2617d19d-d9fb-47a1-8da3-8b4c7ea111cc tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:33.179588 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-2617d19d-d9fb-47a1-8da3-8b4c7ea111cc tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2" status: 200 len: 1556 microversion: 2.1 time: 0.192535 Jul 29 05:25:33.180527 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 289/616] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:32 2022] GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2 => generated 1556 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:33.206032 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-1cb1e3bb-32af-466b-be63-39035c931c09 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:33.207259 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-1cb1e3bb-32af-466b-be63-39035c931c09 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 4471f55c-7166-4321-b0ac-438ae8d3e5e2] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:33.213896 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1cb1e3bb-32af-466b-be63-39035c931c09 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:33.214584 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1cb1e3bb-32af-466b-be63-39035c931c09 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:33.215447 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1cb1e3bb-32af-466b-be63-39035c931c09 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:33.216053 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1cb1e3bb-32af-466b-be63-39035c931c09 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:33.310074 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-1cb1e3bb-32af-466b-be63-39035c931c09 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.113930 Jul 29 05:25:33.310907 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 328/617] 10.222.0.49 () {58 vars in 1275 bytes} [Fri Jul 29 05:25:33 2022] GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2/os-interface => generated 285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:25:33.969378 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-bf7b835b-bbdd-473d-986c-d8073e641c4b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:33.970423 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-bf7b835b-bbdd-473d-986c-d8073e641c4b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:33.983239 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bf7b835b-bbdd-473d-986c-d8073e641c4b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:33.984077 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bf7b835b-bbdd-473d-986c-d8073e641c4b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:33.985177 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bf7b835b-bbdd-473d-986c-d8073e641c4b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:33.986032 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bf7b835b-bbdd-473d-986c-d8073e641c4b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:34.260749 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-bf7b835b-bbdd-473d-986c-d8073e641c4b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:34.270096 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-bf7b835b-bbdd-473d-986c-d8073e641c4b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1725 microversion: 2.1 time: 0.305129 Jul 29 05:25:34.284050 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 290/618] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:33 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1725 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:34.905673 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-233d031a-4f5b-4d98-9f04-9c366716a7f8 req-3c41596f-5687-4810-bc21-a860ec8f0802 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4471f55c-7166-4321-b0ac-438ae8d3e5e2", "tag": "cc0ff66d-f4e0-423a-a8ff-dc678b54c231"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:25:34.917046 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-233d031a-4f5b-4d98-9f04-9c366716a7f8 req-3c41596f-5687-4810-bc21-a860ec8f0802 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:34.918024 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-233d031a-4f5b-4d98-9f04-9c366716a7f8 req-3c41596f-5687-4810-bc21-a860ec8f0802 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:34.932583 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-233d031a-4f5b-4d98-9f04-9c366716a7f8 req-3c41596f-5687-4810-bc21-a860ec8f0802 service nova] Creating event network-changed:cc0ff66d-f4e0-423a-a8ff-dc678b54c231 for instance 4471f55c-7166-4321-b0ac-438ae8d3e5e2 on hv-cinder-85127 Jul 29 05:25:34.938280 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-233d031a-4f5b-4d98-9f04-9c366716a7f8 req-3c41596f-5687-4810-bc21-a860ec8f0802 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037124 Jul 29 05:25:34.939505 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 329/619] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:25:35.295196 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-1736fcd9-b91d-4bf4-a8ed-3f762f428c59 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:35.295839 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-1736fcd9-b91d-4bf4-a8ed-3f762f428c59 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:35.307126 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1736fcd9-b91d-4bf4-a8ed-3f762f428c59 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:35.308108 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1736fcd9-b91d-4bf4-a8ed-3f762f428c59 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:35.308958 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1736fcd9-b91d-4bf4-a8ed-3f762f428c59 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:35.309358 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1736fcd9-b91d-4bf4-a8ed-3f762f428c59 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:35.499228 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-1736fcd9-b91d-4bf4-a8ed-3f762f428c59 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:35.509072 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-1736fcd9-b91d-4bf4-a8ed-3f762f428c59 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1725 microversion: 2.1 time: 0.217223 Jul 29 05:25:35.510194 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 291/620] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:35 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:36.535215 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-15ad02cc-df26-45cf-b8a8-1a900a00d9b0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:36.536221 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-15ad02cc-df26-45cf-b8a8-1a900a00d9b0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:36.543008 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-15ad02cc-df26-45cf-b8a8-1a900a00d9b0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:36.543496 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-15ad02cc-df26-45cf-b8a8-1a900a00d9b0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:36.544261 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-15ad02cc-df26-45cf-b8a8-1a900a00d9b0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:36.544708 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-15ad02cc-df26-45cf-b8a8-1a900a00d9b0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:36.676440 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-15ad02cc-df26-45cf-b8a8-1a900a00d9b0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:36.678884 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:25:36.687125 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-15ad02cc-df26-45cf-b8a8-1a900a00d9b0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1725 microversion: 2.1 time: 0.156739 Jul 29 05:25:36.687817 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 330/621] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:36 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:37.709102 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-f83ead47-7ba7-42a5-ab03-75ba061ef7d0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:37.709686 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-f83ead47-7ba7-42a5-ab03-75ba061ef7d0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:37.716209 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f83ead47-7ba7-42a5-ab03-75ba061ef7d0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:37.716656 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f83ead47-7ba7-42a5-ab03-75ba061ef7d0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:37.717410 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f83ead47-7ba7-42a5-ab03-75ba061ef7d0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:37.717844 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f83ead47-7ba7-42a5-ab03-75ba061ef7d0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:37.854648 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-f83ead47-7ba7-42a5-ab03-75ba061ef7d0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:37.864376 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-f83ead47-7ba7-42a5-ab03-75ba061ef7d0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1725 microversion: 2.1 time: 0.159305 Jul 29 05:25:37.865043 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 292/622] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:37 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:38.886789 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-772b8920-b451-4c0d-ad90-fa4ac9dd1669 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:38.887659 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-772b8920-b451-4c0d-ad90-fa4ac9dd1669 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:38.894713 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-772b8920-b451-4c0d-ad90-fa4ac9dd1669 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:38.895168 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-772b8920-b451-4c0d-ad90-fa4ac9dd1669 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:38.895981 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-772b8920-b451-4c0d-ad90-fa4ac9dd1669 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:38.896427 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-772b8920-b451-4c0d-ad90-fa4ac9dd1669 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:39.036447 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-772b8920-b451-4c0d-ad90-fa4ac9dd1669 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:39.044682 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-772b8920-b451-4c0d-ad90-fa4ac9dd1669 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1725 microversion: 2.1 time: 0.161948 Jul 29 05:25:39.045247 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 331/623] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:38 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:40.067957 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-54649c08-b8ad-467a-9d7a-3b4cc4d56d0c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:40.069278 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-54649c08-b8ad-467a-9d7a-3b4cc4d56d0c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:40.071796 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:25:40.077344 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-54649c08-b8ad-467a-9d7a-3b4cc4d56d0c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:40.077883 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-54649c08-b8ad-467a-9d7a-3b4cc4d56d0c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:40.078782 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-54649c08-b8ad-467a-9d7a-3b4cc4d56d0c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:40.079224 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-54649c08-b8ad-467a-9d7a-3b4cc4d56d0c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:40.220687 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-54649c08-b8ad-467a-9d7a-3b4cc4d56d0c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:40.229212 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-54649c08-b8ad-467a-9d7a-3b4cc4d56d0c tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1725 microversion: 2.1 time: 0.166816 Jul 29 05:25:40.229792 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 293/624] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:40 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:41.251813 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-68561c83-eee8-4d1c-9c11-79d0557dd59f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:41.252449 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-68561c83-eee8-4d1c-9c11-79d0557dd59f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:41.255613 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=1 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:25:41.261341 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-68561c83-eee8-4d1c-9c11-79d0557dd59f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:41.261798 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-68561c83-eee8-4d1c-9c11-79d0557dd59f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:41.262587 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-68561c83-eee8-4d1c-9c11-79d0557dd59f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:41.263029 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-68561c83-eee8-4d1c-9c11-79d0557dd59f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:41.403172 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-68561c83-eee8-4d1c-9c11-79d0557dd59f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:41.417955 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-68561c83-eee8-4d1c-9c11-79d0557dd59f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1725 microversion: 2.1 time: 0.169768 Jul 29 05:25:41.418641 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 332/625] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:41 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:42.443434 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-66dea915-1b29-4f4e-b110-c6fb4505f117 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:42.444477 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-66dea915-1b29-4f4e-b110-c6fb4505f117 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:42.451621 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-66dea915-1b29-4f4e-b110-c6fb4505f117 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:42.452086 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-66dea915-1b29-4f4e-b110-c6fb4505f117 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:42.452883 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-66dea915-1b29-4f4e-b110-c6fb4505f117 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:42.453329 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-66dea915-1b29-4f4e-b110-c6fb4505f117 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:42.590564 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-66dea915-1b29-4f4e-b110-c6fb4505f117 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:42.599383 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-66dea915-1b29-4f4e-b110-c6fb4505f117 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1731 microversion: 2.1 time: 0.161209 Jul 29 05:25:42.599955 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 294/626] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:42 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:42.620633 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-cd57d61e-2ba5-42b6-83b3-160a3152dc0b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:42.621213 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-cd57d61e-2ba5-42b6-83b3-160a3152dc0b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:42.627795 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-cd57d61e-2ba5-42b6-83b3-160a3152dc0b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:42.628507 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-cd57d61e-2ba5-42b6-83b3-160a3152dc0b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:42.629341 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-cd57d61e-2ba5-42b6-83b3-160a3152dc0b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:42.629782 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-cd57d61e-2ba5-42b6-83b3-160a3152dc0b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:42.706801 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-cd57d61e-2ba5-42b6-83b3-160a3152dc0b tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089997 Jul 29 05:25:42.707433 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 333/627] 10.222.0.49 () {58 vars in 1275 bytes} [Fri Jul 29 05:25:42 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:25:43.851260 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-991b664f-069d-4caf-a779-5f561e2f62ed req-ddecd62c-e262-4db3-8f93-ac454bc39390 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00171c99-cf39-4ed6-b78a-3bb24272b171", "tag": "b9da91d9-425e-4a0a-af65-aa645da630ad"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:25:43.872460 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-991b664f-069d-4caf-a779-5f561e2f62ed req-ddecd62c-e262-4db3-8f93-ac454bc39390 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:43.875785 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-991b664f-069d-4caf-a779-5f561e2f62ed req-ddecd62c-e262-4db3-8f93-ac454bc39390 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:43.893558 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-991b664f-069d-4caf-a779-5f561e2f62ed req-ddecd62c-e262-4db3-8f93-ac454bc39390 service nova] Creating event network-changed:b9da91d9-425e-4a0a-af65-aa645da630ad for instance 00171c99-cf39-4ed6-b78a-3bb24272b171 on hv-cinder-85127 Jul 29 05:25:43.900206 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-991b664f-069d-4caf-a779-5f561e2f62ed req-ddecd62c-e262-4db3-8f93-ac454bc39390 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054511 Jul 29 05:25:43.901068 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 295/628] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:25:45.916217 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-b21df508-b8fb-4c4d-b889-baf213472ed8 req-ec80ca46-b86d-4b2f-b7ef-5445e865b57a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00171c99-cf39-4ed6-b78a-3bb24272b171", "tag": "b9da91d9-425e-4a0a-af65-aa645da630ad"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:25:45.926243 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-b21df508-b8fb-4c4d-b889-baf213472ed8 req-ec80ca46-b86d-4b2f-b7ef-5445e865b57a service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:45.927320 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-b21df508-b8fb-4c4d-b889-baf213472ed8 req-ec80ca46-b86d-4b2f-b7ef-5445e865b57a service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:45.939488 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-b21df508-b8fb-4c4d-b889-baf213472ed8 req-ec80ca46-b86d-4b2f-b7ef-5445e865b57a service nova] Creating event network-changed:b9da91d9-425e-4a0a-af65-aa645da630ad for instance 00171c99-cf39-4ed6-b78a-3bb24272b171 on hv-cinder-85127 Jul 29 05:25:45.945807 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-b21df508-b8fb-4c4d-b889-baf213472ed8 req-ec80ca46-b86d-4b2f-b7ef-5445e865b57a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033735 Jul 29 05:25:45.946395 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 334/629] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:25:46.283157 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-089e906d-e5d9-479e-9165-5d684b03e8a9 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:46.283823 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-089e906d-e5d9-479e-9165-5d684b03e8a9 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 87501cee-ef3c-4bdb-942c-3fc67c1032d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:46.290792 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-089e906d-e5d9-479e-9165-5d684b03e8a9 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:46.291246 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-089e906d-e5d9-479e-9165-5d684b03e8a9 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:46.292053 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-089e906d-e5d9-479e-9165-5d684b03e8a9 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:46.292488 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-089e906d-e5d9-479e-9165-5d684b03e8a9 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:46.383239 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.objects.instance [None req-089e906d-e5d9-479e-9165-5d684b03e8a9 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lazy-loading 'services' on Instance uuid 87501cee-ef3c-4bdb-942c-3fc67c1032d0 {{(pid=117820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:25:46.463655 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-089e906d-e5d9-479e-9165-5d684b03e8a9 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "DELETE /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0/os-volume_attachments/faa3f728-d929-412b-aedf-62871236c694" status: 202 len: 0 microversion: 2.1 time: 0.185132 Jul 29 05:25:46.464620 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 296/630] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Jul 29 05:25:46 2022] DELETE /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0/os-volume_attachments/faa3f728-d929-412b-aedf-62871236c694 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 05:25:47.594788 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-afb68528-ea8f-42ea-91c1-1e9394d68e6f tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:47.595400 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-afb68528-ea8f-42ea-91c1-1e9394d68e6f tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 87501cee-ef3c-4bdb-942c-3fc67c1032d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:47.601824 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-afb68528-ea8f-42ea-91c1-1e9394d68e6f tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:47.602276 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-afb68528-ea8f-42ea-91c1-1e9394d68e6f tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:47.603073 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-afb68528-ea8f-42ea-91c1-1e9394d68e6f tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:47.603546 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-afb68528-ea8f-42ea-91c1-1e9394d68e6f tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:47.629591 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-afb68528-ea8f-42ea-91c1-1e9394d68e6f tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 87501cee-ef3c-4bdb-942c-3fc67c1032d0] Going to try to terminate instance {{(pid=117821) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 05:25:47.703017 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-afb68528-ea8f-42ea-91c1-1e9394d68e6f tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "DELETE /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0" status: 204 len: 0 microversion: 2.1 time: 0.112693 Jul 29 05:25:47.703911 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 335/631] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 05:25:47 2022] DELETE /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 05:25:47.712680 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-0870e87d-b93f-4080-9899-de7591d2a15a tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:47.713377 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-0870e87d-b93f-4080-9899-de7591d2a15a tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 87501cee-ef3c-4bdb-942c-3fc67c1032d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:47.720143 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0870e87d-b93f-4080-9899-de7591d2a15a tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:47.720597 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0870e87d-b93f-4080-9899-de7591d2a15a tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:47.721370 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0870e87d-b93f-4080-9899-de7591d2a15a tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:47.721811 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0870e87d-b93f-4080-9899-de7591d2a15a tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:47.858125 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-0870e87d-b93f-4080-9899-de7591d2a15a tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:47.866683 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-0870e87d-b93f-4080-9899-de7591d2a15a tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0" status: 200 len: 1513 microversion: 2.1 time: 0.158121 Jul 29 05:25:47.867264 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 297/632] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:47 2022] GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:48.889206 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-77141e67-2949-4b4e-aae9-13fe1eae0098 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:48.889968 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-77141e67-2949-4b4e-aae9-13fe1eae0098 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 87501cee-ef3c-4bdb-942c-3fc67c1032d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:48.896908 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-77141e67-2949-4b4e-aae9-13fe1eae0098 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:48.897367 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-77141e67-2949-4b4e-aae9-13fe1eae0098 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:48.898144 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-77141e67-2949-4b4e-aae9-13fe1eae0098 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:48.898621 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-77141e67-2949-4b4e-aae9-13fe1eae0098 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:49.044334 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-77141e67-2949-4b4e-aae9-13fe1eae0098 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:49.051997 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-77141e67-2949-4b4e-aae9-13fe1eae0098 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0" status: 200 len: 1513 microversion: 2.1 time: 0.167110 Jul 29 05:25:49.052584 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 336/633] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:48 2022] GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:50.072810 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-f71cd014-cb3d-4023-a389-0c9701389a2d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:50.073760 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-f71cd014-cb3d-4023-a389-0c9701389a2d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 87501cee-ef3c-4bdb-942c-3fc67c1032d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:50.080638 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f71cd014-cb3d-4023-a389-0c9701389a2d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:50.081094 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f71cd014-cb3d-4023-a389-0c9701389a2d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:50.082069 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f71cd014-cb3d-4023-a389-0c9701389a2d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:50.082761 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f71cd014-cb3d-4023-a389-0c9701389a2d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:50.327712 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-f71cd014-cb3d-4023-a389-0c9701389a2d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1690be2d7032472391fa96e23e0c1bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f75331a524c4a5a981dfd1fdc361467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:25:50.336517 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-f71cd014-cb3d-4023-a389-0c9701389a2d tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0" status: 200 len: 1513 microversion: 2.1 time: 0.267925 Jul 29 05:25:50.337109 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 298/634] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:50 2022] GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0 => generated 1513 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:25:50.638219 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-b3202230-547d-4409-97b5-a0c4431a695a req-95fa1606-ed3e-4061-945d-a23ba6be3759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87501cee-ef3c-4bdb-942c-3fc67c1032d0", "name": "network-vif-deleted", "tag": "0cf03d4c-168e-46d0-b7d2-ec0918ad036b"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:25:50.652309 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-b3202230-547d-4409-97b5-a0c4431a695a req-95fa1606-ed3e-4061-945d-a23ba6be3759 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:50.652843 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-b3202230-547d-4409-97b5-a0c4431a695a req-95fa1606-ed3e-4061-945d-a23ba6be3759 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:50.666666 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-b3202230-547d-4409-97b5-a0c4431a695a req-95fa1606-ed3e-4061-945d-a23ba6be3759 service nova] Creating event network-vif-deleted:0cf03d4c-168e-46d0-b7d2-ec0918ad036b for instance 87501cee-ef3c-4bdb-942c-3fc67c1032d0 on hv-cinder-85127 Jul 29 05:25:50.672011 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-b3202230-547d-4409-97b5-a0c4431a695a req-95fa1606-ed3e-4061-945d-a23ba6be3759 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037503 Jul 29 05:25:50.672712 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 337/635] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:25:51.358318 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-40ee78ec-d649-4786-a103-e140bfd7d745 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:51.358888 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-40ee78ec-d649-4786-a103-e140bfd7d745 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] [instance: 87501cee-ef3c-4bdb-942c-3fc67c1032d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:51.366176 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-40ee78ec-d649-4786-a103-e140bfd7d745 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:51.366620 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-40ee78ec-d649-4786-a103-e140bfd7d745 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:51.367408 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-40ee78ec-d649-4786-a103-e140bfd7d745 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:51.367843 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-40ee78ec-d649-4786-a103-e140bfd7d745 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:51.381642 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.wsgi [None req-40ee78ec-d649-4786-a103-e140bfd7d745 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] HTTP exception thrown: Instance 87501cee-ef3c-4bdb-942c-3fc67c1032d0 could not be found. Jul 29 05:25:51.383260 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-40ee78ec-d649-4786-a103-e140bfd7d745 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Request method failure captured: Jul 29 05:25:51.383260 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: request: GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0 HTTP/1.1 Jul 29 05:25:51.383260 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept: application/json Jul 29 05:25:51.383260 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept-Encoding: identity Jul 29 05:25:51.383260 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Connection: close Jul 29 05:25:51.383260 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Length: 0 Jul 29 05:25:51.383260 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Type: application/json Jul 29 05:25:51.383260 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Host: 10.222.0.49 Jul 29 05:25:51.383260 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Openstack-System-Scope: None Jul 29 05:25:51.383260 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: User-Agent: python-urllib3/1.26.10 Jul 29 05:25:51.383260 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Auth-Token: gAAAAABi427RMdBC2S3Jkyx5DLQwh1PBNabeRRWII7P3s8i88GhoFUIdU_MERfLomcJ6mznfnqUe1GmYSLxTu38GUYObXwx2ipgkHkev8EwoSrzsUA2liWP5lPk1oKHkLoog9dZ4lwPLEcDRCFT2kEKSXSDrf-TB6A0JHTcmtF0LozWefwYNZz8 Jul 29 05:25:51.383260 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Id: None Jul 29 05:25:51.383260 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Name: None Jul 29 05:25:51.383260 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Identity-Status: Confirmed Jul 29 05:25:51.383260 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Is-Admin-Project: True Jul 29 05:25:51.383260 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Id: default Jul 29 05:25:51.383260 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Name: Default Jul 29 05:25:51.383260 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Id: 1f75331a524c4a5a981dfd1fdc361467 Jul 29 05:25:51.383260 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2043845827 Jul 29 05:25:51.383260 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Role: member,reader Jul 29 05:25:51.383260 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Roles: member,reader Jul 29 05:25:51.384875 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1f75331a524c4a5a981dfd1fdc361467"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1f75331a524c4a5a981dfd1fdc361467"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1f75331a524c4a5a981dfd1fdc361467"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1f75331a524c4a5a981dfd1fdc361467"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:25:51.384875 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant: tempest-VolumesSnapshotTestJSON-2043845827 Jul 29 05:25:51.384875 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Id: 1f75331a524c4a5a981dfd1fdc361467 Jul 29 05:25:51.384875 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2043845827 Jul 29 05:25:51.384875 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User: tempest-VolumesSnapshotTestJSON-2043845827-project Jul 29 05:25:51.384875 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Id: default Jul 29 05:25:51.384875 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Name: Default Jul 29 05:25:51.384875 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Id: 1690be2d7032472391fa96e23e0c1bf0 Jul 29 05:25:51.384875 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Name: tempest-VolumesSnapshotTestJSON-2043845827-project Jul 29 05:25:51.384875 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: method: > Jul 29 05:25:51.384875 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: exception: Instance 87501cee-ef3c-4bdb-942c-3fc67c1032d0 could not be found. Jul 29 05:25:51.384875 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: action_args: {'id': '87501cee-ef3c-4bdb-942c-3fc67c1032d0'} Jul 29 05:25:51.385754 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:25:51.385754 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:25:51.385754 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:25:51.385754 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:25:51.385754 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:25:51.385754 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:25:51.385754 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:25:51.385754 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:25:51.385754 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:25:51.385754 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:25:51.385754 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87501cee-ef3c-4bdb-942c-3fc67c1032d0 could not be found. Jul 29 05:25:51.385754 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:25:51.385754 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:25:51.385754 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:25:51.385754 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:25:51.385754 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:25:51.385754 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:25:51.385754 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:25:51.385754 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:25:51.385754 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:25:51.387254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:25:51.387254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:25:51.387254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:25:51.387254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:25:51.387254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:25:51.387254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:25:51.387254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:25:51.387254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87501cee-ef3c-4bdb-942c-3fc67c1032d0 could not be found. Jul 29 05:25:51.387254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:25:51.387254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:25:51.387254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:25:51.387254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:25:51.387254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:25:51.387254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:25:51.387254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:25:51.387254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:25:51.387254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87501cee-ef3c-4bdb-942c-3fc67c1032d0 could not be found. Jul 29 05:25:51.387254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:25:51.388660 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-40ee78ec-d649-4786-a103-e140bfd7d745 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] Returning 404 to user: Instance 87501cee-ef3c-4bdb-942c-3fc67c1032d0 could not be found. {{(pid=117820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:25:51.388660 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-40ee78ec-d649-4786-a103-e140bfd7d745 tempest-VolumesSnapshotTestJSON-2043845827 tempest-VolumesSnapshotTestJSON-2043845827-project] 10.222.0.49 "GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0" status: 404 len: 111 microversion: 2.1 time: 0.030424 Jul 29 05:25:51.388660 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 299/636] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:25:51 2022] GET /compute/v2.1/servers/87501cee-ef3c-4bdb-942c-3fc67c1032d0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 05:25:58.972705 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-ac8edad4-521c-4ee4-8e0b-cb8f899eed7e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:58.973301 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-ac8edad4-521c-4ee4-8e0b-cb8f899eed7e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:58.980291 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ac8edad4-521c-4ee4-8e0b-cb8f899eed7e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:58.980753 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ac8edad4-521c-4ee4-8e0b-cb8f899eed7e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:58.981524 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ac8edad4-521c-4ee4-8e0b-cb8f899eed7e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:58.981966 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ac8edad4-521c-4ee4-8e0b-cb8f899eed7e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:59.013109 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-ac8edad4-521c-4ee4-8e0b-cb8f899eed7e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0/os-volume_attachments/8ac1d70f-5eb7-4c7a-8de9-d8a9e5abd25c" status: 200 len: 194 microversion: 2.20 time: 0.045640 Jul 29 05:25:59.020435 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 338/637] 10.222.0.49 () {60 vars in 1454 bytes} [Fri Jul 29 05:25:58 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0/os-volume_attachments/8ac1d70f-5eb7-4c7a-8de9-d8a9e5abd25c => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 05:25:59.084693 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-94bf2525-33e6-45ab-b962-952c6029f77f tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:59.085206 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-94bf2525-33e6-45ab-b962-952c6029f77f tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:59.091853 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-94bf2525-33e6-45ab-b962-952c6029f77f tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:59.092314 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-94bf2525-33e6-45ab-b962-952c6029f77f tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:59.093072 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-94bf2525-33e6-45ab-b962-952c6029f77f tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:59.093516 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-94bf2525-33e6-45ab-b962-952c6029f77f tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:59.176043 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.objects.instance [None req-94bf2525-33e6-45ab-b962-952c6029f77f tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lazy-loading 'services' on Instance uuid 6ff4221e-eadc-491b-9f3c-9b41413a63d0 {{(pid=117820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:25:59.246716 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-94bf2525-33e6-45ab-b962-952c6029f77f tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0/os-volume_attachments/8ac1d70f-5eb7-4c7a-8de9-d8a9e5abd25c" status: 202 len: 0 microversion: 2.20 time: 0.166698 Jul 29 05:25:59.247428 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 300/638] 10.222.0.49 () {60 vars in 1457 bytes} [Fri Jul 29 05:25:59 2022] DELETE /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0/os-volume_attachments/8ac1d70f-5eb7-4c7a-8de9-d8a9e5abd25c => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 29 05:25:59.256236 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-f30aae2a-f6a2-4b6d-a8a9-46113ef88220 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:25:59.258413 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-f30aae2a-f6a2-4b6d-a8a9-46113ef88220 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:25:59.264648 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f30aae2a-f6a2-4b6d-a8a9-46113ef88220 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:59.265436 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f30aae2a-f6a2-4b6d-a8a9-46113ef88220 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:59.265949 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f30aae2a-f6a2-4b6d-a8a9-46113ef88220 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:25:59.266418 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f30aae2a-f6a2-4b6d-a8a9-46113ef88220 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:25:59.298414 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-f30aae2a-f6a2-4b6d-a8a9-46113ef88220 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046715 Jul 29 05:25:59.298997 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 339/639] 10.222.0.49 () {60 vars in 1343 bytes} [Fri Jul 29 05:25:59 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 05:26:00.313278 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-50c5dcc3-8da2-4df4-8afc-3a9c439138f9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:00.316096 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-50c5dcc3-8da2-4df4-8afc-3a9c439138f9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:00.322352 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-50c5dcc3-8da2-4df4-8afc-3a9c439138f9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:00.322809 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-50c5dcc3-8da2-4df4-8afc-3a9c439138f9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:00.323623 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-50c5dcc3-8da2-4df4-8afc-3a9c439138f9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:00.324067 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-50c5dcc3-8da2-4df4-8afc-3a9c439138f9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:00.353226 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-50c5dcc3-8da2-4df4-8afc-3a9c439138f9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045022 Jul 29 05:26:00.353780 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 301/640] 10.222.0.49 () {60 vars in 1343 bytes} [Fri Jul 29 05:26:00 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:00.415762 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-c52181d2-48d8-4783-86b0-a7f2eec90d7d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:00.416287 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-c52181d2-48d8-4783-86b0-a7f2eec90d7d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:00.422801 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c52181d2-48d8-4783-86b0-a7f2eec90d7d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:00.423253 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c52181d2-48d8-4783-86b0-a7f2eec90d7d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:00.424048 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c52181d2-48d8-4783-86b0-a7f2eec90d7d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:00.424491 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c52181d2-48d8-4783-86b0-a7f2eec90d7d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:00.449619 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-c52181d2-48d8-4783-86b0-a7f2eec90d7d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Going to try to terminate instance {{(pid=117821) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 05:26:00.525098 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-c52181d2-48d8-4783-86b0-a7f2eec90d7d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 204 len: 0 microversion: 2.20 time: 0.113364 Jul 29 05:26:00.525674 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 340/641] 10.222.0.49 () {60 vars in 1280 bytes} [Fri Jul 29 05:26:00 2022] DELETE /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 29 05:26:00.537953 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-327ef656-e315-40a0-b810-e8ed6bdfdd81 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:00.538912 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-327ef656-e315-40a0-b810-e8ed6bdfdd81 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:00.545050 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-327ef656-e315-40a0-b810-e8ed6bdfdd81 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:00.545508 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-327ef656-e315-40a0-b810-e8ed6bdfdd81 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:00.546279 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-327ef656-e315-40a0-b810-e8ed6bdfdd81 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:00.546722 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-327ef656-e315-40a0-b810-e8ed6bdfdd81 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:00.928804 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-327ef656-e315-40a0-b810-e8ed6bdfdd81 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:00.937801 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-327ef656-e315-40a0-b810-e8ed6bdfdd81 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:00.939419 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-327ef656-e315-40a0-b810-e8ed6bdfdd81 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:00.941460 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-327ef656-e315-40a0-b810-e8ed6bdfdd81 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1722 microversion: 2.20 time: 0.409665 Jul 29 05:26:00.942092 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 302/642] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:26:00 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1722 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:26:01.966016 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-43a9372e-ab52-4db4-8387-50f2a848dd45 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:01.966726 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-43a9372e-ab52-4db4-8387-50f2a848dd45 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:01.973691 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-43a9372e-ab52-4db4-8387-50f2a848dd45 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:01.974140 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-43a9372e-ab52-4db4-8387-50f2a848dd45 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:01.974890 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-43a9372e-ab52-4db4-8387-50f2a848dd45 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:01.975321 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-43a9372e-ab52-4db4-8387-50f2a848dd45 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:02.321746 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-43a9372e-ab52-4db4-8387-50f2a848dd45 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:02.330243 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-43a9372e-ab52-4db4-8387-50f2a848dd45 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:02.332291 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-43a9372e-ab52-4db4-8387-50f2a848dd45 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:02.333468 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-43a9372e-ab52-4db4-8387-50f2a848dd45 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1722 microversion: 2.20 time: 0.372127 Jul 29 05:26:02.334030 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 341/643] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:26:01 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1722 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:26:03.357748 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-511c859c-d2b1-4738-adec-f8a40486c6b2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:03.358357 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-511c859c-d2b1-4738-adec-f8a40486c6b2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:03.365591 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-511c859c-d2b1-4738-adec-f8a40486c6b2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:03.366039 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-511c859c-d2b1-4738-adec-f8a40486c6b2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:03.366805 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-511c859c-d2b1-4738-adec-f8a40486c6b2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:03.367245 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-511c859c-d2b1-4738-adec-f8a40486c6b2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:03.369919 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=2 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:26:03.503393 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-511c859c-d2b1-4738-adec-f8a40486c6b2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:03.512153 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-511c859c-d2b1-4738-adec-f8a40486c6b2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:03.513424 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-511c859c-d2b1-4738-adec-f8a40486c6b2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:03.514659 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-511c859c-d2b1-4738-adec-f8a40486c6b2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1722 microversion: 2.20 time: 0.161057 Jul 29 05:26:03.515224 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 303/644] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:26:03 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:26:04.537603 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-fe0fb627-dabd-42e1-8514-7620ee731f46 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:04.538256 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-fe0fb627-dabd-42e1-8514-7620ee731f46 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:04.544875 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-fe0fb627-dabd-42e1-8514-7620ee731f46 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:04.545329 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-fe0fb627-dabd-42e1-8514-7620ee731f46 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:04.546092 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-fe0fb627-dabd-42e1-8514-7620ee731f46 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:04.546529 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-fe0fb627-dabd-42e1-8514-7620ee731f46 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:04.686206 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-fe0fb627-dabd-42e1-8514-7620ee731f46 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:04.694878 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-fe0fb627-dabd-42e1-8514-7620ee731f46 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:04.696425 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-fe0fb627-dabd-42e1-8514-7620ee731f46 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:04.697781 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-fe0fb627-dabd-42e1-8514-7620ee731f46 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1722 microversion: 2.20 time: 0.164847 Jul 29 05:26:04.698369 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 342/645] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:26:04 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:26:05.624488 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-6d1c8bc5-560a-4a31-b274-e14a076db268 req-5841cc1d-1a48-427c-a62e-49e15b6c6f9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ff4221e-eadc-491b-9f3c-9b41413a63d0", "name": "network-vif-deleted", "tag": "de35419f-6c42-424f-baf0-e88731e69e60"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:26:05.640879 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-6d1c8bc5-560a-4a31-b274-e14a076db268 req-5841cc1d-1a48-427c-a62e-49e15b6c6f9d service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:05.654603 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-6d1c8bc5-560a-4a31-b274-e14a076db268 req-5841cc1d-1a48-427c-a62e-49e15b6c6f9d service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:05.673149 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-6d1c8bc5-560a-4a31-b274-e14a076db268 req-5841cc1d-1a48-427c-a62e-49e15b6c6f9d service nova] Creating event network-vif-deleted:de35419f-6c42-424f-baf0-e88731e69e60 for instance 6ff4221e-eadc-491b-9f3c-9b41413a63d0 on hv-cinder-85127 Jul 29 05:26:05.679367 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-6d1c8bc5-560a-4a31-b274-e14a076db268 req-5841cc1d-1a48-427c-a62e-49e15b6c6f9d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059800 Jul 29 05:26:05.680864 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 304/646] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:26:05.723788 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-3767d4d1-c73a-4bf6-8e84-13c06be575bd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:05.725147 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-3767d4d1-c73a-4bf6-8e84-13c06be575bd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:05.732851 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3767d4d1-c73a-4bf6-8e84-13c06be575bd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:05.733580 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3767d4d1-c73a-4bf6-8e84-13c06be575bd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:05.734591 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3767d4d1-c73a-4bf6-8e84-13c06be575bd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:05.735343 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3767d4d1-c73a-4bf6-8e84-13c06be575bd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:05.772659 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3767d4d1-c73a-4bf6-8e84-13c06be575bd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:05.773516 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3767d4d1-c73a-4bf6-8e84-13c06be575bd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:05.774195 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.objects.instance [None req-3767d4d1-c73a-4bf6-8e84-13c06be575bd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lazy-loading 'fault' on Instance uuid 6ff4221e-eadc-491b-9f3c-9b41413a63d0 {{(pid=117821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:26:05.819470 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-3767d4d1-c73a-4bf6-8e84-13c06be575bd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:05.828579 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-3767d4d1-c73a-4bf6-8e84-13c06be575bd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:05.830485 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-3767d4d1-c73a-4bf6-8e84-13c06be575bd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:05.832466 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-3767d4d1-c73a-4bf6-8e84-13c06be575bd tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 200 len: 1371 microversion: 2.20 time: 0.114271 Jul 29 05:26:05.833253 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 343/647] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:26:05 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 1371 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:26:06.859891 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-594d6e6d-113a-4357-bab9-41af2b61d6f2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:06.861018 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-594d6e6d-113a-4357-bab9-41af2b61d6f2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:06.870251 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-594d6e6d-113a-4357-bab9-41af2b61d6f2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:06.871055 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-594d6e6d-113a-4357-bab9-41af2b61d6f2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:06.872389 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-594d6e6d-113a-4357-bab9-41af2b61d6f2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:06.872757 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-594d6e6d-113a-4357-bab9-41af2b61d6f2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:06.896926 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.wsgi [None req-594d6e6d-113a-4357-bab9-41af2b61d6f2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] HTTP exception thrown: Instance 6ff4221e-eadc-491b-9f3c-9b41413a63d0 could not be found. Jul 29 05:26:06.898692 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-594d6e6d-113a-4357-bab9-41af2b61d6f2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Request method failure captured: Jul 29 05:26:06.898692 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: request: GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 HTTP/1.1 Jul 29 05:26:06.898692 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept: application/json Jul 29 05:26:06.898692 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept-Encoding: identity Jul 29 05:26:06.898692 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Connection: close Jul 29 05:26:06.898692 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Length: 0 Jul 29 05:26:06.898692 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Type: application/json Jul 29 05:26:06.898692 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Host: 10.222.0.49 Jul 29 05:26:06.898692 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Openstack-System-Scope: None Jul 29 05:26:06.898692 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: User-Agent: python-urllib3/1.26.10 Jul 29 05:26:06.898692 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Auth-Token: gAAAAABi425Wlc4p_qd8_4l8mvU_HADpC4ZjzYoo_9W1HUPbd6RmXuohTZ3lhQXrsrcNhSr9Qq_a7_8mhLduOPGGI8qOnU6NBJB60RVdJ2xWow69o4C1ksosKVYwMFUuC9f3Jm0QPh3neB_ZG_wUT7nqUKLPa-Xz0CfKRaQx9F_P-fYD8bG9Y5o Jul 29 05:26:06.898692 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Id: None Jul 29 05:26:06.898692 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Name: None Jul 29 05:26:06.898692 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Identity-Status: Confirmed Jul 29 05:26:06.898692 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Is-Admin-Project: True Jul 29 05:26:06.898692 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 05:26:06.898692 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Id: default Jul 29 05:26:06.898692 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Name: Default Jul 29 05:26:06.898692 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Id: 9fda8c6d9ffa4955b2f19411ee340cb3 Jul 29 05:26:06.898692 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1359370483 Jul 29 05:26:06.898692 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Role: member,reader Jul 29 05:26:06.898692 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Roles: member,reader Jul 29 05:26:06.900322 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9fda8c6d9ffa4955b2f19411ee340cb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9fda8c6d9ffa4955b2f19411ee340cb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9fda8c6d9ffa4955b2f19411ee340cb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9fda8c6d9ffa4955b2f19411ee340cb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:26:06.900322 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1359370483 Jul 29 05:26:06.900322 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Id: 9fda8c6d9ffa4955b2f19411ee340cb3 Jul 29 05:26:06.900322 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1359370483 Jul 29 05:26:06.900322 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User: tempest-AttachVolumeShelveTestJSON-1359370483-project Jul 29 05:26:06.900322 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Id: default Jul 29 05:26:06.900322 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Name: Default Jul 29 05:26:06.900322 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Id: af5a109a6fb94042aeacbf141d7322ef Jul 29 05:26:06.900322 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1359370483-project Jul 29 05:26:06.900322 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: method: > Jul 29 05:26:06.900322 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: exception: Instance 6ff4221e-eadc-491b-9f3c-9b41413a63d0 could not be found. Jul 29 05:26:06.900322 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: action_args: {'id': '6ff4221e-eadc-491b-9f3c-9b41413a63d0'} Jul 29 05:26:06.901145 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:26:06.901145 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:26:06.901145 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:26:06.901145 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:26:06.901145 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:26:06.901145 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:26:06.901145 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:26:06.901145 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:26:06.901145 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:26:06.901145 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:26:06.901145 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ff4221e-eadc-491b-9f3c-9b41413a63d0 could not be found. Jul 29 05:26:06.901145 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:26:06.901145 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:26:06.901145 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:26:06.901145 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:26:06.901145 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:26:06.901145 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:26:06.901145 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:26:06.901145 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:26:06.901145 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:26:06.902469 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:26:06.902469 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:26:06.902469 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:26:06.902469 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:26:06.902469 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:26:06.902469 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:26:06.902469 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:26:06.902469 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ff4221e-eadc-491b-9f3c-9b41413a63d0 could not be found. Jul 29 05:26:06.902469 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:26:06.902469 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:26:06.902469 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:26:06.902469 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:26:06.902469 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:26:06.902469 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:26:06.902469 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:26:06.902469 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:26:06.902469 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ff4221e-eadc-491b-9f3c-9b41413a63d0 could not be found. Jul 29 05:26:06.902469 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:26:06.903827 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-594d6e6d-113a-4357-bab9-41af2b61d6f2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Returning 404 to user: Instance 6ff4221e-eadc-491b-9f3c-9b41413a63d0 could not be found. {{(pid=117820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:26:06.903827 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-594d6e6d-113a-4357-bab9-41af2b61d6f2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 404 len: 111 microversion: 2.20 time: 0.046947 Jul 29 05:26:06.903827 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 305/648] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:26:06 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 29 05:26:06.912299 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-43b4edf6-b23f-4eb8-b37d-fab2e28994d5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '.version_select at 0x7fa63ac1a0d0>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:06.937030 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-43b4edf6-b23f-4eb8-b37d-fab2e28994d5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-491656657" status: 204 len: 0 microversion: 2.20 time: 0.029212 Jul 29 05:26:06.937664 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 344/649] 10.222.0.49 () {60 vars in 1259 bytes} [Fri Jul 29 05:26:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-491656657 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 29 05:26:07.645353 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-f78397d6-c6b7-4f3e-b943-ab44108255ae tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Action: 'create', calling method: .version_select at 0x7fa63adabca0>, body: {"keypair": {"name": "tempest-keypair-787158419", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNA6GCipB8sT+Lz/kARClqiet7+zruFk8AVszBqhGYOMAnd7SxJzcwEK7ZfRjXN2nCD/L+GitHuR/gd+XuAjdPnyjI0NlkZJLxxdGIXtS9fWPGhoYyDD5/gRnVZ4RduVYA=="}} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:26:07.660863 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.quota [None req-f78397d6-c6b7-4f3e-b943-ab44108255ae tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Getting quotas for project 9fda8c6d9ffa4955b2f19411ee340cb3. Resources: {'key_pairs'} {{(pid=117820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:26:07.664701 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.quota [None req-f78397d6-c6b7-4f3e-b943-ab44108255ae tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Getting quotas for user af5a109a6fb94042aeacbf141d7322ef and project 9fda8c6d9ffa4955b2f19411ee340cb3. Resources: {'key_pairs'} {{(pid=117820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:26:07.687076 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-f78397d6-c6b7-4f3e-b943-ab44108255ae tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.045640 Jul 29 05:26:07.687738 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 306/650] 10.222.0.49 () {62 vars in 1200 bytes} [Fri Jul 29 05:26:07 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 29 05:26:09.109788 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-4bebd19f-2ab7-4e61-bf33-c69bda99e890 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1526240963", "imageRef": "b7bf870d-4e7c-42fd-849f-72ac19277493", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2abd58fa-fb8d-4cc3-8df0-c903c7b8dd87"}], "security_groups": [{"name": "tempest-securitygroup--835847388"}], "key_name": "tempest-keypair-787158419", "user_data": "}} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:26:09.222840 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.network.neutron [None req-4bebd19f-2ab7-4e61-bf33-c69bda99e890 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] validate_networks() for [('2abd58fa-fb8d-4cc3-8df0-c903c7b8dd87', None, None, None, None, None)] {{(pid=117821) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 05:26:09.638444 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-4bebd19f-2ab7-4e61-bf33-c69bda99e890 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Flavor limits 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 05:26:09.638920 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-4bebd19f-2ab7-4e61-bf33-c69bda99e890 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Image limits 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 05:26:09.639496 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-4bebd19f-2ab7-4e61-bf33-c69bda99e890 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Flavor pref 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 05:26:09.640036 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-4bebd19f-2ab7-4e61-bf33-c69bda99e890 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Image pref 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 05:26:09.640495 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-4bebd19f-2ab7-4e61-bf33-c69bda99e890 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 05:26:09.650356 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4bebd19f-2ab7-4e61-bf33-c69bda99e890 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:09.650814 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4bebd19f-2ab7-4e61-bf33-c69bda99e890 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:09.651660 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4bebd19f-2ab7-4e61-bf33-c69bda99e890 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:09.652099 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4bebd19f-2ab7-4e61-bf33-c69bda99e890 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:09.659236 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:26:09.676253 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.quota [None req-4bebd19f-2ab7-4e61-bf33-c69bda99e890 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Getting quotas for project 9fda8c6d9ffa4955b2f19411ee340cb3. Resources: {'instances', 'ram', 'cores'} {{(pid=117821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:26:09.681693 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.quota [None req-4bebd19f-2ab7-4e61-bf33-c69bda99e890 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Getting quotas for user af5a109a6fb94042aeacbf141d7322ef and project 9fda8c6d9ffa4955b2f19411ee340cb3. Resources: {'instances', 'ram', 'cores'} {{(pid=117821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:26:09.694896 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-4bebd19f-2ab7-4e61-bf33-c69bda99e890 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Going to run 1 instances... {{(pid=117821) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 05:26:09.697804 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-4bebd19f-2ab7-4e61-bf33-c69bda99e890 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b7bf870d-4e7c-42fd-849f-72ac19277493',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117821) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 05:26:09.748735 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-4bebd19f-2ab7-4e61-bf33-c69bda99e890 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.643809 Jul 29 05:26:09.749427 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 345/651] 10.222.0.49 () {62 vars in 1188 bytes} [Fri Jul 29 05:26:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 29 05:26:09.761502 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-06f470c9-bb10-4ebd-b9df-1228de5540d4 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:09.762138 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-06f470c9-bb10-4ebd-b9df-1228de5540d4 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:09.888214 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-06f470c9-bb10-4ebd-b9df-1228de5540d4 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:09.896220 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-06f470c9-bb10-4ebd-b9df-1228de5540d4 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:09.897721 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-06f470c9-bb10-4ebd-b9df-1228de5540d4 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:09.898971 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-06f470c9-bb10-4ebd-b9df-1228de5540d4 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1281 microversion: 2.20 time: 0.142072 Jul 29 05:26:09.900049 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 307/652] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:26:09 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1281 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:26:10.922618 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-32ec1559-cd5a-48fe-85cb-d4d67482f3a6 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:10.923246 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-32ec1559-cd5a-48fe-85cb-d4d67482f3a6 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:10.932306 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-32ec1559-cd5a-48fe-85cb-d4d67482f3a6 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:10.933249 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-32ec1559-cd5a-48fe-85cb-d4d67482f3a6 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:10.934077 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-32ec1559-cd5a-48fe-85cb-d4d67482f3a6 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:10.935229 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-32ec1559-cd5a-48fe-85cb-d4d67482f3a6 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:11.001981 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-32ec1559-cd5a-48fe-85cb-d4d67482f3a6 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:11.010637 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-32ec1559-cd5a-48fe-85cb-d4d67482f3a6 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:11.012222 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-32ec1559-cd5a-48fe-85cb-d4d67482f3a6 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:11.013353 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-32ec1559-cd5a-48fe-85cb-d4d67482f3a6 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1339 microversion: 2.20 time: 0.095310 Jul 29 05:26:11.013928 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 346/653] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:26:10 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1339 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:26:12.047644 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-703027ae-3339-44bf-ae0a-0f8a773b1054 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:12.048614 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-703027ae-3339-44bf-ae0a-0f8a773b1054 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:12.053204 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:26:12.064416 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-703027ae-3339-44bf-ae0a-0f8a773b1054 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:12.065227 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-703027ae-3339-44bf-ae0a-0f8a773b1054 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:12.066597 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-703027ae-3339-44bf-ae0a-0f8a773b1054 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:12.067246 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-703027ae-3339-44bf-ae0a-0f8a773b1054 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:12.368097 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-703027ae-3339-44bf-ae0a-0f8a773b1054 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:12.378135 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-703027ae-3339-44bf-ae0a-0f8a773b1054 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:12.379764 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-703027ae-3339-44bf-ae0a-0f8a773b1054 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:12.381120 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-703027ae-3339-44bf-ae0a-0f8a773b1054 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1406 microversion: 2.20 time: 0.343764 Jul 29 05:26:12.381878 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 308/654] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:26:12 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1406 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:26:12.720065 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-19add5fb-6011-402a-9689-590d2d285ff6 req-e525b4f1-4781-487e-b7e6-8ee520a64eff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e3305fc-3d92-4d3f-afb8-c25395280792", "tag": "6f412c06-c9c0-4423-b60d-0b7fa2c32b6f"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:26:12.733483 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:26:12.744709 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-19add5fb-6011-402a-9689-590d2d285ff6 req-e525b4f1-4781-487e-b7e6-8ee520a64eff service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:12.745157 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-19add5fb-6011-402a-9689-590d2d285ff6 req-e525b4f1-4781-487e-b7e6-8ee520a64eff service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:12.761317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-19add5fb-6011-402a-9689-590d2d285ff6 req-e525b4f1-4781-487e-b7e6-8ee520a64eff service nova] Creating event network-changed:6f412c06-c9c0-4423-b60d-0b7fa2c32b6f for instance 1e3305fc-3d92-4d3f-afb8-c25395280792 on hv-cinder-85127 Jul 29 05:26:12.771653 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-19add5fb-6011-402a-9689-590d2d285ff6 req-e525b4f1-4781-487e-b7e6-8ee520a64eff service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055471 Jul 29 05:26:12.772721 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 347/655] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:26:13.404361 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-d33a64df-fca1-4497-8697-22b9d8a894e9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:13.404995 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-d33a64df-fca1-4497-8697-22b9d8a894e9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:13.413130 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d33a64df-fca1-4497-8697-22b9d8a894e9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:13.413594 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d33a64df-fca1-4497-8697-22b9d8a894e9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:13.414391 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d33a64df-fca1-4497-8697-22b9d8a894e9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:13.414964 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d33a64df-fca1-4497-8697-22b9d8a894e9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:13.642235 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-d33a64df-fca1-4497-8697-22b9d8a894e9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:13.652385 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-d33a64df-fca1-4497-8697-22b9d8a894e9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:13.654294 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-d33a64df-fca1-4497-8697-22b9d8a894e9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:13.655700 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-d33a64df-fca1-4497-8697-22b9d8a894e9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1406 microversion: 2.20 time: 0.255424 Jul 29 05:26:13.656086 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 309/656] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:26:13 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1406 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:26:14.679033 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-baabe75f-2328-4258-8010-eb2d2cd2eb02 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:14.679747 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-baabe75f-2328-4258-8010-eb2d2cd2eb02 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:14.687677 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-baabe75f-2328-4258-8010-eb2d2cd2eb02 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:14.688131 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-baabe75f-2328-4258-8010-eb2d2cd2eb02 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:14.688892 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-baabe75f-2328-4258-8010-eb2d2cd2eb02 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:14.689331 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-baabe75f-2328-4258-8010-eb2d2cd2eb02 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:14.842080 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-baabe75f-2328-4258-8010-eb2d2cd2eb02 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:14.852319 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-baabe75f-2328-4258-8010-eb2d2cd2eb02 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:14.853700 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-baabe75f-2328-4258-8010-eb2d2cd2eb02 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:14.854844 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-baabe75f-2328-4258-8010-eb2d2cd2eb02 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1406 microversion: 2.20 time: 0.180074 Jul 29 05:26:14.856352 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 348/657] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:26:14 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:26:15.254542 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-f23e71c4-fb46-4188-8636-4be48b0b940a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:15.257023 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-f23e71c4-fb46-4188-8636-4be48b0b940a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:15.264287 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f23e71c4-fb46-4188-8636-4be48b0b940a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:15.264830 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f23e71c4-fb46-4188-8636-4be48b0b940a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:15.265696 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f23e71c4-fb46-4188-8636-4be48b0b940a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:15.266142 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f23e71c4-fb46-4188-8636-4be48b0b940a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:15.304042 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-f23e71c4-fb46-4188-8636-4be48b0b940a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054257 Jul 29 05:26:15.304633 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 310/658] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:26:15 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 29 05:26:15.374993 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-38572f2f-e36b-4a4b-928d-8a038881eda8 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:15.376275 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-38572f2f-e36b-4a4b-928d-8a038881eda8 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:15.383752 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-38572f2f-e36b-4a4b-928d-8a038881eda8 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:15.384208 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-38572f2f-e36b-4a4b-928d-8a038881eda8 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:15.385109 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-38572f2f-e36b-4a4b-928d-8a038881eda8 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:15.385560 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-38572f2f-e36b-4a4b-928d-8a038881eda8 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:15.416095 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-38572f2f-e36b-4a4b-928d-8a038881eda8 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Going to try to terminate instance {{(pid=117821) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 05:26:15.525687 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-38572f2f-e36b-4a4b-928d-8a038881eda8 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 204 len: 0 microversion: 2.1 time: 0.154388 Jul 29 05:26:15.526658 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 349/659] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 05:26:15 2022] DELETE /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 05:26:15.542855 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-64e65670-668d-415b-8a54-bbf487cff26e tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:15.544174 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-64e65670-668d-415b-8a54-bbf487cff26e tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:15.556290 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-64e65670-668d-415b-8a54-bbf487cff26e tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:15.557204 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-64e65670-668d-415b-8a54-bbf487cff26e tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:15.558637 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-64e65670-668d-415b-8a54-bbf487cff26e tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:15.559539 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-64e65670-668d-415b-8a54-bbf487cff26e tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:15.826697 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-64e65670-668d-415b-8a54-bbf487cff26e tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:15.838543 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-64e65670-668d-415b-8a54-bbf487cff26e tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1673 microversion: 2.1 time: 0.302989 Jul 29 05:26:15.839312 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 311/660] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:15 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1673 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:26:15.886393 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-d904a65a-9205-42d4-949e-0b8045c2a75a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:15.887755 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-d904a65a-9205-42d4-949e-0b8045c2a75a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:15.895566 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d904a65a-9205-42d4-949e-0b8045c2a75a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:15.896017 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d904a65a-9205-42d4-949e-0b8045c2a75a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:15.896803 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d904a65a-9205-42d4-949e-0b8045c2a75a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:15.897244 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d904a65a-9205-42d4-949e-0b8045c2a75a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:16.067786 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-d904a65a-9205-42d4-949e-0b8045c2a75a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:16.078913 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-d904a65a-9205-42d4-949e-0b8045c2a75a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:16.082905 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-d904a65a-9205-42d4-949e-0b8045c2a75a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:16.085448 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-d904a65a-9205-42d4-949e-0b8045c2a75a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1406 microversion: 2.20 time: 0.211202 Jul 29 05:26:16.086404 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 350/661] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:26:15 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:26:16.871195 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-0135759a-f0a5-4ec9-8b67-db75c5811244 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:16.871195 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-0135759a-f0a5-4ec9-8b67-db75c5811244 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:16.881827 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0135759a-f0a5-4ec9-8b67-db75c5811244 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:16.882765 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0135759a-f0a5-4ec9-8b67-db75c5811244 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:16.884321 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0135759a-f0a5-4ec9-8b67-db75c5811244 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:16.885222 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0135759a-f0a5-4ec9-8b67-db75c5811244 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:17.067961 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-0135759a-f0a5-4ec9-8b67-db75c5811244 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:17.080134 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-0135759a-f0a5-4ec9-8b67-db75c5811244 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1673 microversion: 2.1 time: 0.220525 Jul 29 05:26:17.080689 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 312/662] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:16 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1673 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:17.109481 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-60ee7b20-93c3-4cbc-ab84-ab549a3747cf tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:17.110120 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-60ee7b20-93c3-4cbc-ab84-ab549a3747cf tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:17.117845 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-60ee7b20-93c3-4cbc-ab84-ab549a3747cf tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:17.118298 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-60ee7b20-93c3-4cbc-ab84-ab549a3747cf tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:17.119074 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-60ee7b20-93c3-4cbc-ab84-ab549a3747cf tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:17.119539 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-60ee7b20-93c3-4cbc-ab84-ab549a3747cf tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:17.288507 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-60ee7b20-93c3-4cbc-ab84-ab549a3747cf tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:17.296985 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-60ee7b20-93c3-4cbc-ab84-ab549a3747cf tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:17.298632 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-60ee7b20-93c3-4cbc-ab84-ab549a3747cf tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:17.300913 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-60ee7b20-93c3-4cbc-ab84-ab549a3747cf tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1406 microversion: 2.20 time: 0.195938 Jul 29 05:26:17.301875 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 351/663] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:26:17 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:26:18.109146 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-d8bded83-f2c2-4fad-88f3-28585f9a909a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:18.110468 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-d8bded83-f2c2-4fad-88f3-28585f9a909a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:18.118510 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d8bded83-f2c2-4fad-88f3-28585f9a909a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:18.118960 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d8bded83-f2c2-4fad-88f3-28585f9a909a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:18.120028 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d8bded83-f2c2-4fad-88f3-28585f9a909a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:18.120445 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d8bded83-f2c2-4fad-88f3-28585f9a909a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:18.340197 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-4c44b7f6-ff00-4566-8049-2d96ed2a964b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:18.342921 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-4c44b7f6-ff00-4566-8049-2d96ed2a964b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:18.369057 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4c44b7f6-ff00-4566-8049-2d96ed2a964b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:18.372313 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4c44b7f6-ff00-4566-8049-2d96ed2a964b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:18.374454 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4c44b7f6-ff00-4566-8049-2d96ed2a964b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:18.375501 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4c44b7f6-ff00-4566-8049-2d96ed2a964b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:18.596874 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-d8bded83-f2c2-4fad-88f3-28585f9a909a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:18.606073 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-d8bded83-f2c2-4fad-88f3-28585f9a909a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1673 microversion: 2.1 time: 0.500977 Jul 29 05:26:18.607070 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 313/664] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:18 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1673 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:26:18.612414 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-b255f4aa-da69-473a-847e-e878f9d1e11a req-8f19d448-5ce4-41d9-9845-54b66738e3f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e3305fc-3d92-4d3f-afb8-c25395280792", "name": "network-vif-plugged", "status": "completed", "tag": "6f412c06-c9c0-4423-b60d-0b7fa2c32b6f"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:26:18.622790 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-b255f4aa-da69-473a-847e-e878f9d1e11a req-8f19d448-5ce4-41d9-9845-54b66738e3f0 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:18.623680 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-b255f4aa-da69-473a-847e-e878f9d1e11a req-8f19d448-5ce4-41d9-9845-54b66738e3f0 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:18.638325 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-b255f4aa-da69-473a-847e-e878f9d1e11a req-8f19d448-5ce4-41d9-9845-54b66738e3f0 service nova] Creating event network-vif-plugged:6f412c06-c9c0-4423-b60d-0b7fa2c32b6f for instance 1e3305fc-3d92-4d3f-afb8-c25395280792 on hv-cinder-85127 Jul 29 05:26:18.646678 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-b255f4aa-da69-473a-847e-e878f9d1e11a req-8f19d448-5ce4-41d9-9845-54b66738e3f0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037978 Jul 29 05:26:18.648091 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 314/665] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:26:19.089146 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-4c44b7f6-ff00-4566-8049-2d96ed2a964b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:19.101725 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-4c44b7f6-ff00-4566-8049-2d96ed2a964b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:19.103437 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-4c44b7f6-ff00-4566-8049-2d96ed2a964b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:19.104807 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-4c44b7f6-ff00-4566-8049-2d96ed2a964b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1406 microversion: 2.20 time: 0.781466 Jul 29 05:26:19.128071 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 352/666] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:26:18 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1406 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:26:19.287450 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-a0a4ca5e-58ff-4b92-9294-6ac10ad4cec3 req-22386ab9-07cd-4853-9a94-d3fbc1bc73a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6ff83e9-b98e-47c5-83cb-37ac61826fba", "name": "network-vif-deleted", "tag": "271bc52d-2fba-4db9-bfaa-44a4a119f24e"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:26:19.324527 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-a0a4ca5e-58ff-4b92-9294-6ac10ad4cec3 req-22386ab9-07cd-4853-9a94-d3fbc1bc73a5 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:19.326120 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-a0a4ca5e-58ff-4b92-9294-6ac10ad4cec3 req-22386ab9-07cd-4853-9a94-d3fbc1bc73a5 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:19.367806 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-a0a4ca5e-58ff-4b92-9294-6ac10ad4cec3 req-22386ab9-07cd-4853-9a94-d3fbc1bc73a5 service nova] Creating event network-vif-deleted:271bc52d-2fba-4db9-bfaa-44a4a119f24e for instance f6ff83e9-b98e-47c5-83cb-37ac61826fba on hv-cinder-85127 Jul 29 05:26:19.380960 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-a0a4ca5e-58ff-4b92-9294-6ac10ad4cec3 req-22386ab9-07cd-4853-9a94-d3fbc1bc73a5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105312 Jul 29 05:26:19.385803 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 315/667] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:26:19.633416 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-03d6e95c-3779-4132-a895-d5f80449f5d3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:19.634477 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-03d6e95c-3779-4132-a895-d5f80449f5d3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:19.646881 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-03d6e95c-3779-4132-a895-d5f80449f5d3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:19.647499 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-03d6e95c-3779-4132-a895-d5f80449f5d3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:19.649594 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-03d6e95c-3779-4132-a895-d5f80449f5d3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:19.650186 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-03d6e95c-3779-4132-a895-d5f80449f5d3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:19.681669 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell0:SELECT=2 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:26:19.691805 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell0:SELECT=6 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:26:19.712308 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-03d6e95c-3779-4132-a895-d5f80449f5d3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:19.713097 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-03d6e95c-3779-4132-a895-d5f80449f5d3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:19.713795 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.objects.instance [None req-03d6e95c-3779-4132-a895-d5f80449f5d3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lazy-loading 'fault' on Instance uuid f6ff83e9-b98e-47c5-83cb-37ac61826fba {{(pid=117821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:26:19.798059 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-03d6e95c-3779-4132-a895-d5f80449f5d3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:19.810171 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-03d6e95c-3779-4132-a895-d5f80449f5d3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 200 len: 1327 microversion: 2.1 time: 0.180878 Jul 29 05:26:19.811252 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 353/668] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:19 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 1327 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:20.128603 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell0:SELECT=6 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:26:20.133930 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-7242e41b-b8cd-4ea8-aef3-23abcad208c7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:20.135170 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-7242e41b-b8cd-4ea8-aef3-23abcad208c7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:20.143633 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7242e41b-b8cd-4ea8-aef3-23abcad208c7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:20.144395 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7242e41b-b8cd-4ea8-aef3-23abcad208c7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:20.145866 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7242e41b-b8cd-4ea8-aef3-23abcad208c7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:20.146538 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7242e41b-b8cd-4ea8-aef3-23abcad208c7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:20.338748 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-7242e41b-b8cd-4ea8-aef3-23abcad208c7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:20.348042 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-7242e41b-b8cd-4ea8-aef3-23abcad208c7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:20.349722 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-7242e41b-b8cd-4ea8-aef3-23abcad208c7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:20.350956 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-7242e41b-b8cd-4ea8-aef3-23abcad208c7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1406 microversion: 2.20 time: 0.224415 Jul 29 05:26:20.351552 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 316/669] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:26:20 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1406 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:26:20.834572 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-97e7ad4c-d0a5-443e-b982-0946f2febae6 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:20.835772 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-97e7ad4c-d0a5-443e-b982-0946f2febae6 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:20.851101 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-97e7ad4c-d0a5-443e-b982-0946f2febae6 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:20.852153 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-97e7ad4c-d0a5-443e-b982-0946f2febae6 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:20.854350 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-97e7ad4c-d0a5-443e-b982-0946f2febae6 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:20.855395 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-97e7ad4c-d0a5-443e-b982-0946f2febae6 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:20.889775 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.wsgi [None req-97e7ad4c-d0a5-443e-b982-0946f2febae6 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] HTTP exception thrown: Instance f6ff83e9-b98e-47c5-83cb-37ac61826fba could not be found. Jul 29 05:26:20.893674 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-97e7ad4c-d0a5-443e-b982-0946f2febae6 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Request method failure captured: Jul 29 05:26:20.893674 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: request: GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba HTTP/1.1 Jul 29 05:26:20.893674 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept: application/json Jul 29 05:26:20.893674 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept-Encoding: identity Jul 29 05:26:20.893674 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Connection: close Jul 29 05:26:20.893674 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Length: 0 Jul 29 05:26:20.893674 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Type: application/json Jul 29 05:26:20.893674 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Host: 10.222.0.49 Jul 29 05:26:20.893674 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Openstack-System-Scope: None Jul 29 05:26:20.893674 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: User-Agent: python-urllib3/1.26.10 Jul 29 05:26:20.893674 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Auth-Token: gAAAAABi425XzClJm-mqNh7trJiRa8zhb1JdfD6kuObTAyJnIB1UhZxLI0lbverA-I-cqLqY2-6zazXj0ABWM0tRJVMiiwcj6fNQimGe2sHqHh0Dd6CmzaJbVp4d6ziugG1GM1lcAGKDzbJwkhlElXBLu-SxPfmbAT0H0dUDL9OEj_FVqnWyrC8 Jul 29 05:26:20.893674 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Id: None Jul 29 05:26:20.893674 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Name: None Jul 29 05:26:20.893674 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Identity-Status: Confirmed Jul 29 05:26:20.893674 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Is-Admin-Project: True Jul 29 05:26:20.893674 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Id: default Jul 29 05:26:20.893674 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Name: Default Jul 29 05:26:20.893674 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Id: 92f16adc2357459aa0afb68db89031dd Jul 29 05:26:20.893674 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Name: tempest-AttachVolumeTestJSON-1982834268 Jul 29 05:26:20.893674 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Role: member,reader Jul 29 05:26:20.893674 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Roles: member,reader Jul 29 05:26:20.895868 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/92f16adc2357459aa0afb68db89031dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/92f16adc2357459aa0afb68db89031dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_92f16adc2357459aa0afb68db89031dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/92f16adc2357459aa0afb68db89031dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:26:20.895868 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant: tempest-AttachVolumeTestJSON-1982834268 Jul 29 05:26:20.895868 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Id: 92f16adc2357459aa0afb68db89031dd Jul 29 05:26:20.895868 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1982834268 Jul 29 05:26:20.895868 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User: tempest-AttachVolumeTestJSON-1982834268-project Jul 29 05:26:20.895868 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Id: default Jul 29 05:26:20.895868 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Name: Default Jul 29 05:26:20.895868 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Id: c2db6ada97da4ee89f3ce8de98f2653a Jul 29 05:26:20.895868 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Name: tempest-AttachVolumeTestJSON-1982834268-project Jul 29 05:26:20.895868 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: method: > Jul 29 05:26:20.895868 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: exception: Instance f6ff83e9-b98e-47c5-83cb-37ac61826fba could not be found. Jul 29 05:26:20.895868 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: action_args: {'id': 'f6ff83e9-b98e-47c5-83cb-37ac61826fba'} Jul 29 05:26:20.896713 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:26:20.896713 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:26:20.896713 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:26:20.896713 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:26:20.896713 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:26:20.896713 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:26:20.896713 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:26:20.896713 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:26:20.896713 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:26:20.896713 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:26:20.896713 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6ff83e9-b98e-47c5-83cb-37ac61826fba could not be found. Jul 29 05:26:20.896713 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:26:20.896713 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:26:20.896713 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:26:20.896713 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:26:20.896713 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:26:20.896713 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:26:20.896713 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:26:20.896713 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:26:20.896713 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:26:20.898129 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:26:20.898129 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:26:20.898129 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:26:20.898129 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:26:20.898129 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:26:20.898129 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:26:20.898129 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:26:20.898129 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6ff83e9-b98e-47c5-83cb-37ac61826fba could not be found. Jul 29 05:26:20.898129 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:26:20.898129 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:26:20.898129 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:26:20.898129 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:26:20.898129 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:26:20.898129 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:26:20.898129 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:26:20.898129 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:26:20.898129 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6ff83e9-b98e-47c5-83cb-37ac61826fba could not be found. Jul 29 05:26:20.898129 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:26:20.901953 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-97e7ad4c-d0a5-443e-b982-0946f2febae6 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Returning 404 to user: Instance f6ff83e9-b98e-47c5-83cb-37ac61826fba could not be found. {{(pid=117821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:26:20.903070 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-97e7ad4c-d0a5-443e-b982-0946f2febae6 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 404 len: 111 microversion: 2.1 time: 0.072511 Jul 29 05:26:20.904604 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 354/670] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:20 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:26:20.914663 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-4ff97017-e439-436c-843e-899e16d65bf2 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '.version_select at 0x7fa63abb2670>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:20.951374 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-4ff97017-e439-436c-843e-899e16d65bf2 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-707859948" status: 202 len: 0 microversion: 2.1 time: 0.040624 Jul 29 05:26:20.957205 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 317/671] 10.222.0.49 () {58 vars in 1218 bytes} [Fri Jul 29 05:26:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-707859948 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 05:26:21.374469 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-6cd7ff17-a1c2-4186-aa8f-06cfb8e5282b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:21.375261 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-6cd7ff17-a1c2-4186-aa8f-06cfb8e5282b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:21.402562 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6cd7ff17-a1c2-4186-aa8f-06cfb8e5282b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:21.405286 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6cd7ff17-a1c2-4186-aa8f-06cfb8e5282b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:21.408580 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6cd7ff17-a1c2-4186-aa8f-06cfb8e5282b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:21.410460 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6cd7ff17-a1c2-4186-aa8f-06cfb8e5282b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:21.712554 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-6cd7ff17-a1c2-4186-aa8f-06cfb8e5282b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:21.726471 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-6cd7ff17-a1c2-4186-aa8f-06cfb8e5282b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:21.728442 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-6cd7ff17-a1c2-4186-aa8f-06cfb8e5282b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:21.733985 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-6cd7ff17-a1c2-4186-aa8f-06cfb8e5282b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1597 microversion: 2.20 time: 0.364389 Jul 29 05:26:21.751050 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 355/672] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:26:21 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1597 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:26:21.761339 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-c222703e-5cec-4227-8113-f2bd25df4474 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:21.762203 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-c222703e-5cec-4227-8113-f2bd25df4474 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:21.787321 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c222703e-5cec-4227-8113-f2bd25df4474 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:21.788273 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c222703e-5cec-4227-8113-f2bd25df4474 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:21.789352 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c222703e-5cec-4227-8113-f2bd25df4474 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:21.790010 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c222703e-5cec-4227-8113-f2bd25df4474 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:21.965591 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-d0b313c7-5fe4-4acb-9d55-5dd468aad6f8 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:21.967476 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-d0b313c7-5fe4-4acb-9d55-5dd468aad6f8 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 4471f55c-7166-4321-b0ac-438ae8d3e5e2] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:21.978501 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d0b313c7-5fe4-4acb-9d55-5dd468aad6f8 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:21.979216 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d0b313c7-5fe4-4acb-9d55-5dd468aad6f8 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:21.980506 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d0b313c7-5fe4-4acb-9d55-5dd468aad6f8 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:21.981265 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d0b313c7-5fe4-4acb-9d55-5dd468aad6f8 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:22.012551 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-d0b313c7-5fe4-4acb-9d55-5dd468aad6f8 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2/ips" status: 200 len: 150 microversion: 2.1 time: 0.366404 Jul 29 05:26:22.021097 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 318/673] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Jul 29 05:26:21 2022] GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2/ips => generated 150 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:26:22.054886 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-c222703e-5cec-4227-8113-f2bd25df4474 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.300764 Jul 29 05:26:22.056218 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 356/674] 10.222.0.49 () {60 vars in 1316 bytes} [Fri Jul 29 05:26:21 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792/os-interface => generated 284 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 05:26:22.369296 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-5b785200-4c93-40a9-b34c-6114b89fd55a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Action: 'create', calling method: .version_select at 0x7fa6400540d0>, body: {"keypair": {"name": "tempest-keypair-1200714588", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPZU/amEilOmvkSrI4L5r6vt85EIbD2LpM0vIbZRYTiE5UCrjVPe7IyWnk7WrRtu4pMKWEMWCGIrP6LdkNzpo6vN0wyp8pT3u5KpXFAHy+9meIitrYOfwPCfyBplaVCCg=="}} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:26:22.400142 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.quota [None req-5b785200-4c93-40a9-b34c-6114b89fd55a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Getting quotas for project 92f16adc2357459aa0afb68db89031dd. Resources: {'key_pairs'} {{(pid=117820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:26:22.409998 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.quota [None req-5b785200-4c93-40a9-b34c-6114b89fd55a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Getting quotas for user c2db6ada97da4ee89f3ce8de98f2653a and project 92f16adc2357459aa0afb68db89031dd. Resources: {'key_pairs'} {{(pid=117820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:26:22.459499 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-5b785200-4c93-40a9-b34c-6114b89fd55a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.093110 Jul 29 05:26:22.483193 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 319/675] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Jul 29 05:26:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:26:23.708021 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-4cb08c6d-cd08-4183-b1d9-becfc0d12430 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f576535b-91d0-4674-8b45-3f072b1b22f6"}} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:26:23.710442 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-4cb08c6d-cd08-4183-b1d9-becfc0d12430 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 4471f55c-7166-4321-b0ac-438ae8d3e5e2] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:23.717852 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4cb08c6d-cd08-4183-b1d9-becfc0d12430 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:23.718316 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4cb08c6d-cd08-4183-b1d9-becfc0d12430 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:23.719110 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4cb08c6d-cd08-4183-b1d9-becfc0d12430 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:23.719578 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4cb08c6d-cd08-4183-b1d9-becfc0d12430 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:24.084031 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-4cb08c6d-cd08-4183-b1d9-becfc0d12430 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "POST /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.380416 Jul 29 05:26:24.085033 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 357/676] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Jul 29 05:26:23 2022] POST /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2/os-volume_attachments => generated 194 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:26:24.542348 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-79f42709-4fc2-4bae-94a4-b4a5fde91846 req-1e4d49cb-3608-4db6-bd56-a775c20f22f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e3305fc-3d92-4d3f-afb8-c25395280792", "tag": "6f412c06-c9c0-4423-b60d-0b7fa2c32b6f"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:26:24.584761 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-79f42709-4fc2-4bae-94a4-b4a5fde91846 req-1e4d49cb-3608-4db6-bd56-a775c20f22f0 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:24.585623 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-79f42709-4fc2-4bae-94a4-b4a5fde91846 req-1e4d49cb-3608-4db6-bd56-a775c20f22f0 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:24.615613 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-79f42709-4fc2-4bae-94a4-b4a5fde91846 req-1e4d49cb-3608-4db6-bd56-a775c20f22f0 service nova] Creating event network-changed:6f412c06-c9c0-4423-b60d-0b7fa2c32b6f for instance 1e3305fc-3d92-4d3f-afb8-c25395280792 on hv-cinder-85127 Jul 29 05:26:24.624171 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-79f42709-4fc2-4bae-94a4-b4a5fde91846 req-1e4d49cb-3608-4db6-bd56-a775c20f22f0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085915 Jul 29 05:26:24.625057 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 320/677] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:26:25.022413 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-49db30c3-c3b6-4f27-bba5-a0281621a395 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:25.023218 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-49db30c3-c3b6-4f27-bba5-a0281621a395 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:25.040431 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-49db30c3-c3b6-4f27-bba5-a0281621a395 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:25.041012 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-49db30c3-c3b6-4f27-bba5-a0281621a395 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:25.041890 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-49db30c3-c3b6-4f27-bba5-a0281621a395 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:25.043397 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-49db30c3-c3b6-4f27-bba5-a0281621a395 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:25.220845 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.objects.instance [None req-49db30c3-c3b6-4f27-bba5-a0281621a395 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lazy-loading 'services' on Instance uuid 00171c99-cf39-4ed6-b78a-3bb24272b171 {{(pid=117821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:26:25.481694 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-49db30c3-c3b6-4f27-bba5-a0281621a395 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "DELETE /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171/os-volume_attachments/596e7484-d6fd-4d29-b72b-02ba35278ef9" status: 202 len: 0 microversion: 2.1 time: 0.452341 Jul 29 05:26:25.484152 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 358/678] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Jul 29 05:26:25 2022] DELETE /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171/os-volume_attachments/596e7484-d6fd-4d29-b72b-02ba35278ef9 => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 05:26:25.495955 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-b5596473-2d4b-490b-89ed-eb71b80145a9 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:25.498846 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-b5596473-2d4b-490b-89ed-eb71b80145a9 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:25.522779 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-6ce764b4-9af6-4e85-bdf5-2c5bf65ace22 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1601431280", "imageRef": "b7bf870d-4e7c-42fd-849f-72ac19277493", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60b4bb7c-7825-4f15-bc04-5ac3fa10b445"}], "security_groups": [{"name": "tempest-securitygroup--779195828"}], "key_name": "tempest-keypair-1200714588", "user_data": "}} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:26:25.536209 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b5596473-2d4b-490b-89ed-eb71b80145a9 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:25.538028 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b5596473-2d4b-490b-89ed-eb71b80145a9 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:25.539532 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b5596473-2d4b-490b-89ed-eb71b80145a9 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:25.541711 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b5596473-2d4b-490b-89ed-eb71b80145a9 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:25.606648 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-b5596473-2d4b-490b-89ed-eb71b80145a9 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116897 Jul 29 05:26:25.616243 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 321/679] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:26:25 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:26:25.722124 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.network.neutron [None req-6ce764b4-9af6-4e85-bdf5-2c5bf65ace22 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] validate_networks() for [('60b4bb7c-7825-4f15-bc04-5ac3fa10b445', None, None, None, None, None)] {{(pid=117821) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 05:26:26.631852 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-0ebb5cc6-bfb3-4238-989c-b58cc50f5dc5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:26.635883 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-0ebb5cc6-bfb3-4238-989c-b58cc50f5dc5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:26.643967 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-6ce764b4-9af6-4e85-bdf5-2c5bf65ace22 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Flavor limits 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 05:26:26.645374 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-6ce764b4-9af6-4e85-bdf5-2c5bf65ace22 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Image limits 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 05:26:26.646085 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-6ce764b4-9af6-4e85-bdf5-2c5bf65ace22 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Flavor pref 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 05:26:26.646541 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-6ce764b4-9af6-4e85-bdf5-2c5bf65ace22 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Image pref 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 05:26:26.646979 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-6ce764b4-9af6-4e85-bdf5-2c5bf65ace22 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 05:26:26.661726 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6ce764b4-9af6-4e85-bdf5-2c5bf65ace22 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:26.664381 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0ebb5cc6-bfb3-4238-989c-b58cc50f5dc5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:26.665198 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6ce764b4-9af6-4e85-bdf5-2c5bf65ace22 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:26.665860 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0ebb5cc6-bfb3-4238-989c-b58cc50f5dc5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:26.666932 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6ce764b4-9af6-4e85-bdf5-2c5bf65ace22 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:26.668576 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6ce764b4-9af6-4e85-bdf5-2c5bf65ace22 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:26.668772 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0ebb5cc6-bfb3-4238-989c-b58cc50f5dc5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:26.672534 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0ebb5cc6-bfb3-4238-989c-b58cc50f5dc5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:26.717853 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.quota [None req-6ce764b4-9af6-4e85-bdf5-2c5bf65ace22 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Getting quotas for project 92f16adc2357459aa0afb68db89031dd. Resources: {'instances', 'ram', 'cores'} {{(pid=117821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:26:26.726083 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.quota [None req-6ce764b4-9af6-4e85-bdf5-2c5bf65ace22 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Getting quotas for user c2db6ada97da4ee89f3ce8de98f2653a and project 92f16adc2357459aa0afb68db89031dd. Resources: {'instances', 'ram', 'cores'} {{(pid=117821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:26:26.728727 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-0ebb5cc6-bfb3-4238-989c-b58cc50f5dc5 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104334 Jul 29 05:26:26.731724 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 322/680] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:26:26 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:26:26.743068 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-6ce764b4-9af6-4e85-bdf5-2c5bf65ace22 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Going to run 1 instances... {{(pid=117821) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 05:26:26.750285 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-6ce764b4-9af6-4e85-bdf5-2c5bf65ace22 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b7bf870d-4e7c-42fd-849f-72ac19277493',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117821) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 05:26:26.815579 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-6ce764b4-9af6-4e85-bdf5-2c5bf65ace22 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.297002 Jul 29 05:26:26.822568 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 359/681] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 05:26:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 1306 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 29 05:26:26.828602 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-d8b7eac0-422b-4d41-9524-89f8fba8d1f3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:26.831004 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-d8b7eac0-422b-4d41-9524-89f8fba8d1f3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:26.988855 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-d8b7eac0-422b-4d41-9524-89f8fba8d1f3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:26.999721 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-d8b7eac0-422b-4d41-9524-89f8fba8d1f3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9" status: 200 len: 1238 microversion: 2.1 time: 0.174701 Jul 29 05:26:27.000243 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 323/682] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:26 2022] GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9 => generated 1238 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:27.760836 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-5681cbf4-ed94-4923-8dd6-43c1a2c7f778 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:27.768178 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-5681cbf4-ed94-4923-8dd6-43c1a2c7f778 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:27.787970 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5681cbf4-ed94-4923-8dd6-43c1a2c7f778 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:27.790011 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5681cbf4-ed94-4923-8dd6-43c1a2c7f778 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:27.792553 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5681cbf4-ed94-4923-8dd6-43c1a2c7f778 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:27.796126 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5681cbf4-ed94-4923-8dd6-43c1a2c7f778 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:27.843429 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:26:27.851376 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-5681cbf4-ed94-4923-8dd6-43c1a2c7f778 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110558 Jul 29 05:26:27.855728 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 360/683] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:26:27 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:26:28.026241 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-15392d5d-9fd5-46ee-af78-6cbc783d3b87 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:28.027005 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-15392d5d-9fd5-46ee-af78-6cbc783d3b87 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:28.051394 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-15392d5d-9fd5-46ee-af78-6cbc783d3b87 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:28.052305 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-15392d5d-9fd5-46ee-af78-6cbc783d3b87 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:28.058106 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-15392d5d-9fd5-46ee-af78-6cbc783d3b87 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:28.058816 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-15392d5d-9fd5-46ee-af78-6cbc783d3b87 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:28.144297 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-15392d5d-9fd5-46ee-af78-6cbc783d3b87 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:28.158970 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-15392d5d-9fd5-46ee-af78-6cbc783d3b87 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9" status: 200 len: 1234 microversion: 2.1 time: 0.139422 Jul 29 05:26:28.159779 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 324/684] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:28 2022] GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9 => generated 1234 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:28.864887 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-0a1ee0e1-de0a-417d-909d-0123af382892 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:28.867505 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-0a1ee0e1-de0a-417d-909d-0123af382892 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:28.892621 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0a1ee0e1-de0a-417d-909d-0123af382892 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:28.893359 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0a1ee0e1-de0a-417d-909d-0123af382892 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:28.894412 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0a1ee0e1-de0a-417d-909d-0123af382892 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:28.895005 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0a1ee0e1-de0a-417d-909d-0123af382892 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:28.933206 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-0a1ee0e1-de0a-417d-909d-0123af382892 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072757 Jul 29 05:26:28.933792 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 361/685] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:26:28 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:26:29.184248 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-5066f264-e347-41fd-b1d1-df04096f8937 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:29.184956 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-5066f264-e347-41fd-b1d1-df04096f8937 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:29.192358 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5066f264-e347-41fd-b1d1-df04096f8937 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:29.193157 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5066f264-e347-41fd-b1d1-df04096f8937 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:29.194020 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5066f264-e347-41fd-b1d1-df04096f8937 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:29.194662 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5066f264-e347-41fd-b1d1-df04096f8937 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:29.344820 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-5066f264-e347-41fd-b1d1-df04096f8937 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:29.353335 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-5066f264-e347-41fd-b1d1-df04096f8937 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9" status: 200 len: 1296 microversion: 2.1 time: 0.172879 Jul 29 05:26:29.354290 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 325/686] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:29 2022] GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9 => generated 1296 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:29.951382 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-c5e5cc12-7278-40ac-a7da-0b0f9f7f004d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:29.955490 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-c5e5cc12-7278-40ac-a7da-0b0f9f7f004d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:29.973436 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c5e5cc12-7278-40ac-a7da-0b0f9f7f004d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:29.974115 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c5e5cc12-7278-40ac-a7da-0b0f9f7f004d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:29.981414 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c5e5cc12-7278-40ac-a7da-0b0f9f7f004d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:29.982131 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c5e5cc12-7278-40ac-a7da-0b0f9f7f004d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:30.047071 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-c5e5cc12-7278-40ac-a7da-0b0f9f7f004d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101481 Jul 29 05:26:30.048608 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 362/687] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:26:29 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:26:30.666855 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-dd18543d-943b-4c2d-b0bd-dcf0faf5457d tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:30.667706 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-dd18543d-943b-4c2d-b0bd-dcf0faf5457d tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:30.683978 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-dd18543d-943b-4c2d-b0bd-dcf0faf5457d tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:30.684449 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-dd18543d-943b-4c2d-b0bd-dcf0faf5457d tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:30.685260 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-dd18543d-943b-4c2d-b0bd-dcf0faf5457d tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:30.685705 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-dd18543d-943b-4c2d-b0bd-dcf0faf5457d tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:30.893975 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-17963bb6-3683-44d1-83cd-b781f5a89ddf tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f576535b-91d0-4674-8b45-3f072b1b22f6"}} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:26:30.897380 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-17963bb6-3683-44d1-83cd-b781f5a89ddf tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 4471f55c-7166-4321-b0ac-438ae8d3e5e2] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:30.905099 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-17963bb6-3683-44d1-83cd-b781f5a89ddf tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:30.905563 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-17963bb6-3683-44d1-83cd-b781f5a89ddf tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:30.906347 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-17963bb6-3683-44d1-83cd-b781f5a89ddf tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:30.907901 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-17963bb6-3683-44d1-83cd-b781f5a89ddf tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:31.025300 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-dd18543d-943b-4c2d-b0bd-dcf0faf5457d tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:31.030959 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.wsgi [None req-17963bb6-3683-44d1-83cd-b781f5a89ddf tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] HTTP exception thrown: Invalid volume: volume f576535b-91d0-4674-8b45-3f072b1b22f6 is already attached to instances: 4471f55c-7166-4321-b0ac-438ae8d3e5e2 Jul 29 05:26:31.034510 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-17963bb6-3683-44d1-83cd-b781f5a89ddf tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Request method failure captured: Jul 29 05:26:31.034510 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: request: POST /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2/os-volume_attachments HTTP/1.1 Jul 29 05:26:31.034510 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept: application/json Jul 29 05:26:31.034510 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept-Encoding: identity Jul 29 05:26:31.034510 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Connection: close Jul 29 05:26:31.034510 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Length: 74 Jul 29 05:26:31.034510 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Type: application/json Jul 29 05:26:31.034510 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Host: 10.222.0.49 Jul 29 05:26:31.034510 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Openstack-System-Scope: None Jul 29 05:26:31.034510 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: User-Agent: python-urllib3/1.26.10 Jul 29 05:26:31.034510 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Auth-Token: gAAAAABi425JZwki5zTQDTC3iukDv4VCbNzlxQK73dr9mClVYcp-Pvpl82CYunlqvLixJfXv6lMCmXCQFs-hx71b40CIPEvZNAkIclM8nEjPEEMC1q8Qnidc9zW9MB-6S0Nkj4s67ZnGkNw0VjcX1sLTyzzsa2KGY_dj5NlUwZaoPl1fActyKvM Jul 29 05:26:31.034510 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Id: None Jul 29 05:26:31.034510 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Name: None Jul 29 05:26:31.034510 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Identity-Status: Confirmed Jul 29 05:26:31.034510 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Is-Admin-Project: True Jul 29 05:26:31.034510 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Id: default Jul 29 05:26:31.034510 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Name: Default Jul 29 05:26:31.034510 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Id: 9d8baaf2e23546ee8ed1de278617c7d2 Jul 29 05:26:31.034510 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Name: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:26:31.034510 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Role: member,reader Jul 29 05:26:31.034510 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Roles: member,reader Jul 29 05:26:31.036161 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:26:31.036161 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:26:31.036161 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Id: 9d8baaf2e23546ee8ed1de278617c7d2 Jul 29 05:26:31.036161 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:26:31.036161 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User: tempest-AttachVolumeNegativeTest-480684510-project Jul 29 05:26:31.036161 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Id: default Jul 29 05:26:31.036161 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Name: Default Jul 29 05:26:31.036161 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Id: 3c60b3a983f14f50b1b762a3954a1059 Jul 29 05:26:31.036161 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Name: tempest-AttachVolumeNegativeTest-480684510-project Jul 29 05:26:31.036161 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Jul 29 05:26:31.036161 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: {"volumeAttachment": {"volumeId": "f576535b-91d0-4674-8b45-3f072b1b22f6"}} Jul 29 05:26:31.036161 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: method: > Jul 29 05:26:31.037038 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: exception: Invalid volume: volume f576535b-91d0-4674-8b45-3f072b1b22f6 is already attached to instances: 4471f55c-7166-4321-b0ac-438ae8d3e5e2 Jul 29 05:26:31.037038 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: action_args: {'server_id': '4471f55c-7166-4321-b0ac-438ae8d3e5e2', 'body': {'volumeAttachment': {'volumeId': 'f576535b-91d0-4674-8b45-3f072b1b22f6'}}} Jul 29 05:26:31.037038 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:26:31.037038 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:26:31.037038 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 29 05:26:31.037038 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 29 05:26:31.037038 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 29 05:26:31.037038 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 29 05:26:31.037038 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 29 05:26:31.037038 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 29 05:26:31.037038 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Jul 29 05:26:31.037038 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 29 05:26:31.037038 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Jul 29 05:26:31.037038 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 29 05:26:31.037038 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f576535b-91d0-4674-8b45-3f072b1b22f6 is already attached to instances: 4471f55c-7166-4321-b0ac-438ae8d3e5e2 Jul 29 05:26:31.037038 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:26:31.037038 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:26:31.037038 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:26:31.037038 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:26:31.038401 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:26:31.038401 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:26:31.038401 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:26:31.038401 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:26:31.038401 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:26:31.038401 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:26:31.038401 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 05:26:31.038401 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 05:26:31.038401 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 05:26:31.038401 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 05:26:31.038401 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 05:26:31.038401 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 05:26:31.038401 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 29 05:26:31.038401 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 29 05:26:31.038401 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f576535b-91d0-4674-8b45-3f072b1b22f6 is already attached to instances: 4471f55c-7166-4321-b0ac-438ae8d3e5e2 Jul 29 05:26:31.038401 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:26:31.038401 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:26:31.038401 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:26:31.038401 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:26:31.038401 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:26:31.041342 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:26:31.041342 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:26:31.041342 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:26:31.041342 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f576535b-91d0-4674-8b45-3f072b1b22f6 is already attached to instances: 4471f55c-7166-4321-b0ac-438ae8d3e5e2 Jul 29 05:26:31.041342 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:26:31.042292 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-dd18543d-943b-4c2d-b0bd-dcf0faf5457d tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9" status: 200 len: 1363 microversion: 2.1 time: 0.664128 Jul 29 05:26:31.044175 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 326/688] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:30 2022] GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9 => generated 1363 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:31.048891 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-17963bb6-3683-44d1-83cd-b781f5a89ddf tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Returning 400 to user: Invalid volume: volume f576535b-91d0-4674-8b45-3f072b1b22f6 is already attached to instances: 4471f55c-7166-4321-b0ac-438ae8d3e5e2 {{(pid=117821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:26:31.057491 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-17963bb6-3683-44d1-83cd-b781f5a89ddf tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "POST /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.162014 Jul 29 05:26:31.060659 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 363/689] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Jul 29 05:26:30 2022] POST /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2/os-volume_attachments => generated 174 bytes in 173 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 29 05:26:31.074426 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-2848d489-6261-40b3-aadf-47c2007f9c0f req-ba369562-641e-4e6b-8af1-01835cd62319 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62613145-ee65-4472-a5f6-23a6d76ea1b9", "tag": "a7825eab-725a-4a03-8c38-040b1712a57c"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:26:31.097516 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-fd44b788-0709-44e6-8c98-0bb858207781 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:31.106597 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-fd44b788-0709-44e6-8c98-0bb858207781 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:31.122512 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-2848d489-6261-40b3-aadf-47c2007f9c0f req-ba369562-641e-4e6b-8af1-01835cd62319 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:31.126463 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-2848d489-6261-40b3-aadf-47c2007f9c0f req-ba369562-641e-4e6b-8af1-01835cd62319 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:31.163115 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-fd44b788-0709-44e6-8c98-0bb858207781 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:31.166003 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-fd44b788-0709-44e6-8c98-0bb858207781 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:31.180790 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-fd44b788-0709-44e6-8c98-0bb858207781 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:31.182424 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-fd44b788-0709-44e6-8c98-0bb858207781 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:31.188091 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-2848d489-6261-40b3-aadf-47c2007f9c0f req-ba369562-641e-4e6b-8af1-01835cd62319 service nova] Creating event network-changed:a7825eab-725a-4a03-8c38-040b1712a57c for instance 62613145-ee65-4472-a5f6-23a6d76ea1b9 on hv-cinder-85127 Jul 29 05:26:31.215480 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-2848d489-6261-40b3-aadf-47c2007f9c0f req-ba369562-641e-4e6b-8af1-01835cd62319 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158130 Jul 29 05:26:31.216564 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 327/690] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:26:31.246267 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-96e0ad12-fc93-4c40-a22c-1cd255400739 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:31.247276 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-96e0ad12-fc93-4c40-a22c-1cd255400739 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 4471f55c-7166-4321-b0ac-438ae8d3e5e2] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:31.262553 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-fd44b788-0709-44e6-8c98-0bb858207781 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.200045 Jul 29 05:26:31.263735 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 364/691] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:26:31 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171/os-volume_attachments => generated 197 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:26:31.271066 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-96e0ad12-fc93-4c40-a22c-1cd255400739 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:31.271864 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-96e0ad12-fc93-4c40-a22c-1cd255400739 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:31.273306 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-96e0ad12-fc93-4c40-a22c-1cd255400739 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:31.287997 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-96e0ad12-fc93-4c40-a22c-1cd255400739 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:31.532947 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.objects.instance [None req-96e0ad12-fc93-4c40-a22c-1cd255400739 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lazy-loading 'services' on Instance uuid 4471f55c-7166-4321-b0ac-438ae8d3e5e2 {{(pid=117820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:26:31.540181 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell1:SELECT=100 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:26:31.822225 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-96e0ad12-fc93-4c40-a22c-1cd255400739 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2/os-volume_attachments/f576535b-91d0-4674-8b45-3f072b1b22f6" status: 202 len: 0 microversion: 2.1 time: 0.598832 Jul 29 05:26:31.826166 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 328/692] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Jul 29 05:26:31 2022] DELETE /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2/os-volume_attachments/f576535b-91d0-4674-8b45-3f072b1b22f6 => generated 0 bytes in 601 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 05:26:31.834030 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-bddcd004-7df6-448f-bf1b-829840e6b1d5 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:31.836892 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-bddcd004-7df6-448f-bf1b-829840e6b1d5 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 4471f55c-7166-4321-b0ac-438ae8d3e5e2] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:31.857212 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bddcd004-7df6-448f-bf1b-829840e6b1d5 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:31.860536 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bddcd004-7df6-448f-bf1b-829840e6b1d5 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:31.864728 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bddcd004-7df6-448f-bf1b-829840e6b1d5 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:31.865489 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bddcd004-7df6-448f-bf1b-829840e6b1d5 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:31.936559 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-bddcd004-7df6-448f-bf1b-829840e6b1d5 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108432 Jul 29 05:26:31.941986 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 365/693] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:26:31 2022] GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:26:32.073509 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-d67325d6-764c-42ac-baad-7da430b735cc tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:32.074205 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-d67325d6-764c-42ac-baad-7da430b735cc tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:32.084321 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d67325d6-764c-42ac-baad-7da430b735cc tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:32.085718 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d67325d6-764c-42ac-baad-7da430b735cc tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:32.086648 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d67325d6-764c-42ac-baad-7da430b735cc tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:32.087603 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d67325d6-764c-42ac-baad-7da430b735cc tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:32.277706 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-d67325d6-764c-42ac-baad-7da430b735cc tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:32.284901 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-b0b197b9-4374-4be7-87de-2784ea7d93e6 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:32.288830 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-b0b197b9-4374-4be7-87de-2784ea7d93e6 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:32.296656 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-d67325d6-764c-42ac-baad-7da430b735cc tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9" status: 200 len: 1363 microversion: 2.1 time: 0.228106 Jul 29 05:26:32.300320 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 329/694] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:32 2022] GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9 => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:32.302889 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b0b197b9-4374-4be7-87de-2784ea7d93e6 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:32.303652 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b0b197b9-4374-4be7-87de-2784ea7d93e6 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:32.304765 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b0b197b9-4374-4be7-87de-2784ea7d93e6 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:32.305457 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b0b197b9-4374-4be7-87de-2784ea7d93e6 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:32.338971 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-b0b197b9-4374-4be7-87de-2784ea7d93e6 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064509 Jul 29 05:26:32.339960 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 366/695] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:26:32 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 05:26:32.428102 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-9935e052-b558-4a5d-a147-7d7c80fc172a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:32.428596 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-9935e052-b558-4a5d-a147-7d7c80fc172a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:32.436089 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9935e052-b558-4a5d-a147-7d7c80fc172a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:32.440187 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9935e052-b558-4a5d-a147-7d7c80fc172a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:32.441080 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9935e052-b558-4a5d-a147-7d7c80fc172a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:32.441739 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9935e052-b558-4a5d-a147-7d7c80fc172a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:32.476865 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-9935e052-b558-4a5d-a147-7d7c80fc172a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Going to try to terminate instance {{(pid=117820) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 05:26:32.588460 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-9935e052-b558-4a5d-a147-7d7c80fc172a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "DELETE /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 204 len: 0 microversion: 2.1 time: 0.163989 Jul 29 05:26:32.591496 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 330/696] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 05:26:32 2022] DELETE /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 05:26:32.599662 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-6c89a86e-33f3-4177-bcdd-8df5c5ef5ee0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:32.600814 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-6c89a86e-33f3-4177-bcdd-8df5c5ef5ee0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:32.609067 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6c89a86e-33f3-4177-bcdd-8df5c5ef5ee0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:32.610913 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6c89a86e-33f3-4177-bcdd-8df5c5ef5ee0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:32.612415 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6c89a86e-33f3-4177-bcdd-8df5c5ef5ee0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:32.613426 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6c89a86e-33f3-4177-bcdd-8df5c5ef5ee0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:32.893328 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-6c89a86e-33f3-4177-bcdd-8df5c5ef5ee0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:32.902981 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-6c89a86e-33f3-4177-bcdd-8df5c5ef5ee0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1691 microversion: 2.1 time: 0.309077 Jul 29 05:26:32.907452 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 367/697] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:32 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1691 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:32.950243 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-375cce0a-deeb-4e10-910c-cdfa0aca395b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:32.952806 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-375cce0a-deeb-4e10-910c-cdfa0aca395b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 4471f55c-7166-4321-b0ac-438ae8d3e5e2] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:32.961730 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-375cce0a-deeb-4e10-910c-cdfa0aca395b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:32.962189 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-375cce0a-deeb-4e10-910c-cdfa0aca395b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:32.963094 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-375cce0a-deeb-4e10-910c-cdfa0aca395b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:32.963448 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-375cce0a-deeb-4e10-910c-cdfa0aca395b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:32.997477 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-375cce0a-deeb-4e10-910c-cdfa0aca395b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051438 Jul 29 05:26:32.998410 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 331/698] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:26:32 2022] GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:26:33.320888 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-13dd26eb-f337-4ba4-a788-192eb2eecd4b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:33.321604 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-13dd26eb-f337-4ba4-a788-192eb2eecd4b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:33.328309 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-13dd26eb-f337-4ba4-a788-192eb2eecd4b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:33.329420 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-13dd26eb-f337-4ba4-a788-192eb2eecd4b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:33.330210 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-13dd26eb-f337-4ba4-a788-192eb2eecd4b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:33.330762 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-13dd26eb-f337-4ba4-a788-192eb2eecd4b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:33.510437 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-13dd26eb-f337-4ba4-a788-192eb2eecd4b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:33.519985 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-13dd26eb-f337-4ba4-a788-192eb2eecd4b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9" status: 200 len: 1363 microversion: 2.1 time: 0.202580 Jul 29 05:26:33.522473 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 368/699] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:33 2022] GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9 => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:33.927765 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-14dd103a-3623-427a-9ce2-bedfded48d9d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:33.928611 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-14dd103a-3623-427a-9ce2-bedfded48d9d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:33.935761 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-14dd103a-3623-427a-9ce2-bedfded48d9d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:33.936506 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-14dd103a-3623-427a-9ce2-bedfded48d9d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:33.937480 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-14dd103a-3623-427a-9ce2-bedfded48d9d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:33.938762 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-14dd103a-3623-427a-9ce2-bedfded48d9d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:34.009403 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-101548c2-bd16-47cb-b8e1-31e9c74452ca tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:34.011988 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-101548c2-bd16-47cb-b8e1-31e9c74452ca tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 4471f55c-7166-4321-b0ac-438ae8d3e5e2] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:34.027380 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-101548c2-bd16-47cb-b8e1-31e9c74452ca tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:34.034320 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-101548c2-bd16-47cb-b8e1-31e9c74452ca tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:34.036793 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-101548c2-bd16-47cb-b8e1-31e9c74452ca tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:34.038360 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-101548c2-bd16-47cb-b8e1-31e9c74452ca tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:34.104362 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-101548c2-bd16-47cb-b8e1-31e9c74452ca tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099031 Jul 29 05:26:34.111134 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 369/700] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:26:34 2022] GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:26:34.124136 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-14dd103a-3623-427a-9ce2-bedfded48d9d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:34.136322 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-14dd103a-3623-427a-9ce2-bedfded48d9d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1691 microversion: 2.1 time: 0.215068 Jul 29 05:26:34.137031 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 332/701] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:33 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1691 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:34.541225 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-0a0bbae5-6981-4ddf-be4c-86d1f25c315c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:34.542022 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-0a0bbae5-6981-4ddf-be4c-86d1f25c315c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:34.552085 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0a0bbae5-6981-4ddf-be4c-86d1f25c315c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:34.552688 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0a0bbae5-6981-4ddf-be4c-86d1f25c315c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:34.553761 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0a0bbae5-6981-4ddf-be4c-86d1f25c315c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:34.554267 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0a0bbae5-6981-4ddf-be4c-86d1f25c315c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:34.746205 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-0a0bbae5-6981-4ddf-be4c-86d1f25c315c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:34.755916 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-0a0bbae5-6981-4ddf-be4c-86d1f25c315c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9" status: 200 len: 1363 microversion: 2.1 time: 0.218440 Jul 29 05:26:34.757183 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 370/702] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:34 2022] GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:35.118081 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-a37f5f3e-a54c-4ee0-bccc-1fdcafd772da tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:35.120655 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-a37f5f3e-a54c-4ee0-bccc-1fdcafd772da tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 4471f55c-7166-4321-b0ac-438ae8d3e5e2] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:35.129117 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a37f5f3e-a54c-4ee0-bccc-1fdcafd772da tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:35.130643 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a37f5f3e-a54c-4ee0-bccc-1fdcafd772da tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:35.131631 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a37f5f3e-a54c-4ee0-bccc-1fdcafd772da tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:35.132155 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a37f5f3e-a54c-4ee0-bccc-1fdcafd772da tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:35.165138 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-360b1dee-850f-4c5e-a07c-d93c404bb853 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:35.166023 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-360b1dee-850f-4c5e-a07c-d93c404bb853 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:35.181286 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-360b1dee-850f-4c5e-a07c-d93c404bb853 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:35.182005 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-360b1dee-850f-4c5e-a07c-d93c404bb853 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:35.182958 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-360b1dee-850f-4c5e-a07c-d93c404bb853 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:35.183088 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-a37f5f3e-a54c-4ee0-bccc-1fdcafd772da tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068544 Jul 29 05:26:35.183695 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-360b1dee-850f-4c5e-a07c-d93c404bb853 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:35.189398 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 333/703] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:26:35 2022] GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:26:35.371660 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-360b1dee-850f-4c5e-a07c-d93c404bb853 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:35.382401 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-360b1dee-850f-4c5e-a07c-d93c404bb853 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1691 microversion: 2.1 time: 0.222195 Jul 29 05:26:35.383887 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 371/704] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:35 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1691 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:26:35.776935 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-99f8bef4-8708-46e5-b78a-fe40eba1bea1 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:35.779177 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-99f8bef4-8708-46e5-b78a-fe40eba1bea1 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:35.786842 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-99f8bef4-8708-46e5-b78a-fe40eba1bea1 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:35.787621 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-99f8bef4-8708-46e5-b78a-fe40eba1bea1 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:35.788577 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-99f8bef4-8708-46e5-b78a-fe40eba1bea1 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:35.789171 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-99f8bef4-8708-46e5-b78a-fe40eba1bea1 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:35.982662 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-99f8bef4-8708-46e5-b78a-fe40eba1bea1 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:35.994375 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-99f8bef4-8708-46e5-b78a-fe40eba1bea1 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9" status: 200 len: 1363 microversion: 2.1 time: 0.221213 Jul 29 05:26:35.994973 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 334/705] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:35 2022] GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9 => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:36.195018 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-e7799e01-02fd-46e4-8b2a-d0f731baf0bf tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:36.197230 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-e7799e01-02fd-46e4-8b2a-d0f731baf0bf tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 4471f55c-7166-4321-b0ac-438ae8d3e5e2] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:36.223458 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e7799e01-02fd-46e4-8b2a-d0f731baf0bf tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:36.225225 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e7799e01-02fd-46e4-8b2a-d0f731baf0bf tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:36.233965 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e7799e01-02fd-46e4-8b2a-d0f731baf0bf tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:36.236473 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e7799e01-02fd-46e4-8b2a-d0f731baf0bf tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:36.333727 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-e7799e01-02fd-46e4-8b2a-d0f731baf0bf tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141676 Jul 29 05:26:36.338437 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 372/706] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:26:36 2022] GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:26:36.411565 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-9c409ae6-b307-4b5d-a452-e8e90285dd36 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:36.412287 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-9c409ae6-b307-4b5d-a452-e8e90285dd36 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:36.427895 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9c409ae6-b307-4b5d-a452-e8e90285dd36 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:36.428414 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9c409ae6-b307-4b5d-a452-e8e90285dd36 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:36.431147 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9c409ae6-b307-4b5d-a452-e8e90285dd36 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:36.432494 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9c409ae6-b307-4b5d-a452-e8e90285dd36 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:36.993528 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell0:SELECT=6 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:26:37.018075 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-bf367c7a-c012-4da5-aa48-d6a96c6fb763 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:37.018818 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-bf367c7a-c012-4da5-aa48-d6a96c6fb763 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:37.020774 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell0:SELECT=2 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:26:37.021618 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell0:SELECT=6 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:26:37.041376 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bf367c7a-c012-4da5-aa48-d6a96c6fb763 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:37.041882 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bf367c7a-c012-4da5-aa48-d6a96c6fb763 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:37.042859 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bf367c7a-c012-4da5-aa48-d6a96c6fb763 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:37.043221 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bf367c7a-c012-4da5-aa48-d6a96c6fb763 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:37.122003 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-9c409ae6-b307-4b5d-a452-e8e90285dd36 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:37.131650 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-9c409ae6-b307-4b5d-a452-e8e90285dd36 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1691 microversion: 2.1 time: 0.725049 Jul 29 05:26:37.132330 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 335/707] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:36 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1691 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:37.241630 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-66c10191-5beb-4b86-883e-c3abf8886e9c req-58251876-fdfb-4c18-a5de-c601ab8ffde2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62613145-ee65-4472-a5f6-23a6d76ea1b9", "name": "network-vif-plugged", "status": "completed", "tag": "a7825eab-725a-4a03-8c38-040b1712a57c"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:26:37.261349 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-66c10191-5beb-4b86-883e-c3abf8886e9c req-58251876-fdfb-4c18-a5de-c601ab8ffde2 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:37.261795 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-66c10191-5beb-4b86-883e-c3abf8886e9c req-58251876-fdfb-4c18-a5de-c601ab8ffde2 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:37.292460 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-66c10191-5beb-4b86-883e-c3abf8886e9c req-58251876-fdfb-4c18-a5de-c601ab8ffde2 service nova] Creating event network-vif-plugged:a7825eab-725a-4a03-8c38-040b1712a57c for instance 62613145-ee65-4472-a5f6-23a6d76ea1b9 on hv-cinder-85127 Jul 29 05:26:37.295037 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-bf367c7a-c012-4da5-aa48-d6a96c6fb763 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:37.304183 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-66c10191-5beb-4b86-883e-c3abf8886e9c req-58251876-fdfb-4c18-a5de-c601ab8ffde2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066119 Jul 29 05:26:37.306832 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-bf367c7a-c012-4da5-aa48-d6a96c6fb763 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9" status: 200 len: 1363 microversion: 2.1 time: 0.293173 Jul 29 05:26:37.307030 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 336/708] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:26:37.324568 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 373/709] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:37 2022] GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9 => generated 1363 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:37.348772 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-a4fa4ed9-0ffa-496d-952f-ac3e0b5900b4 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:37.352013 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-a4fa4ed9-0ffa-496d-952f-ac3e0b5900b4 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 4471f55c-7166-4321-b0ac-438ae8d3e5e2] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:37.367677 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a4fa4ed9-0ffa-496d-952f-ac3e0b5900b4 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:37.368130 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a4fa4ed9-0ffa-496d-952f-ac3e0b5900b4 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:37.368924 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a4fa4ed9-0ffa-496d-952f-ac3e0b5900b4 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:37.369368 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a4fa4ed9-0ffa-496d-952f-ac3e0b5900b4 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:37.450259 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-a4fa4ed9-0ffa-496d-952f-ac3e0b5900b4 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.107255 Jul 29 05:26:37.450890 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 337/710] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:26:37 2022] GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2/os-volume_attachments => generated 25 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 29 05:26:37.615255 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-f9dc3143-bb1c-4837-a312-73d708eb2ef4 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:37.617364 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-f9dc3143-bb1c-4837-a312-73d708eb2ef4 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 4471f55c-7166-4321-b0ac-438ae8d3e5e2] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:37.641381 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f9dc3143-bb1c-4837-a312-73d708eb2ef4 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:37.642638 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f9dc3143-bb1c-4837-a312-73d708eb2ef4 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:37.646205 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f9dc3143-bb1c-4837-a312-73d708eb2ef4 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:37.647575 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f9dc3143-bb1c-4837-a312-73d708eb2ef4 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:37.706231 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-f9dc3143-bb1c-4837-a312-73d708eb2ef4 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 4471f55c-7166-4321-b0ac-438ae8d3e5e2] Going to try to terminate instance {{(pid=117821) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 05:26:37.963081 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-f9dc3143-bb1c-4837-a312-73d708eb2ef4 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2" status: 204 len: 0 microversion: 2.1 time: 0.358146 Jul 29 05:26:37.964913 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 374/711] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 05:26:37 2022] DELETE /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 05:26:37.974513 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-52229e87-af63-4e27-a923-7288b9cae5dc tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:37.975303 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-52229e87-af63-4e27-a923-7288b9cae5dc tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 4471f55c-7166-4321-b0ac-438ae8d3e5e2] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:37.993108 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-52229e87-af63-4e27-a923-7288b9cae5dc tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:37.993574 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-52229e87-af63-4e27-a923-7288b9cae5dc tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:37.994374 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-52229e87-af63-4e27-a923-7288b9cae5dc tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:37.996419 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-52229e87-af63-4e27-a923-7288b9cae5dc tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:38.159944 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-7b916593-7fa7-4846-a2de-8326c516420d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:38.160940 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-7b916593-7fa7-4846-a2de-8326c516420d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:38.171320 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7b916593-7fa7-4846-a2de-8326c516420d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:38.173559 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7b916593-7fa7-4846-a2de-8326c516420d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:38.181490 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7b916593-7fa7-4846-a2de-8326c516420d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:38.183439 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7b916593-7fa7-4846-a2de-8326c516420d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:38.426747 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-7b916593-7fa7-4846-a2de-8326c516420d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:38.431474 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:26:38.441614 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-7b916593-7fa7-4846-a2de-8326c516420d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1691 microversion: 2.1 time: 0.290144 Jul 29 05:26:38.443425 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 375/712] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:38 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1691 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:38.448816 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-ee84fb7a-c52c-4364-a002-9654fadd213b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:38.449435 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-ee84fb7a-c52c-4364-a002-9654fadd213b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:38.460438 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ee84fb7a-c52c-4364-a002-9654fadd213b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:38.461067 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ee84fb7a-c52c-4364-a002-9654fadd213b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:38.462032 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ee84fb7a-c52c-4364-a002-9654fadd213b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:38.462503 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ee84fb7a-c52c-4364-a002-9654fadd213b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:38.480940 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-52229e87-af63-4e27-a923-7288b9cae5dc tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:38.494858 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-52229e87-af63-4e27-a923-7288b9cae5dc tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2" status: 200 len: 1681 microversion: 2.1 time: 0.524645 Jul 29 05:26:38.495369 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 338/713] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:37 2022] GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2 => generated 1681 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:38.697645 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-ee84fb7a-c52c-4364-a002-9654fadd213b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:38.720729 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-ee84fb7a-c52c-4364-a002-9654fadd213b tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9" status: 200 len: 1363 microversion: 2.1 time: 0.275727 Jul 29 05:26:38.723063 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 376/714] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:38 2022] GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9 => generated 1363 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:39.324533 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-af23d2d2-e05d-4329-bec8-b5e7b5f761e3 req-ae7db183-5be2-4bf1-b106-927e66e543c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00171c99-cf39-4ed6-b78a-3bb24272b171", "name": "network-vif-deleted", "tag": "b9da91d9-425e-4a0a-af65-aa645da630ad"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:26:39.357900 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-af23d2d2-e05d-4329-bec8-b5e7b5f761e3 req-ae7db183-5be2-4bf1-b106-927e66e543c2 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:39.358508 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-af23d2d2-e05d-4329-bec8-b5e7b5f761e3 req-ae7db183-5be2-4bf1-b106-927e66e543c2 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:39.385966 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-af23d2d2-e05d-4329-bec8-b5e7b5f761e3 req-ae7db183-5be2-4bf1-b106-927e66e543c2 service nova] Creating event network-vif-deleted:b9da91d9-425e-4a0a-af65-aa645da630ad for instance 00171c99-cf39-4ed6-b78a-3bb24272b171 on hv-cinder-85127 Jul 29 05:26:39.403947 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-af23d2d2-e05d-4329-bec8-b5e7b5f761e3 req-ae7db183-5be2-4bf1-b106-927e66e543c2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080866 Jul 29 05:26:39.404950 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 339/715] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:26:39.466497 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-0aa77763-cadd-446c-97ea-1960693c09ba tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:39.468105 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-0aa77763-cadd-446c-97ea-1960693c09ba tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:39.480451 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0aa77763-cadd-446c-97ea-1960693c09ba tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:39.481304 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0aa77763-cadd-446c-97ea-1960693c09ba tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:39.484502 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0aa77763-cadd-446c-97ea-1960693c09ba tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:39.485290 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0aa77763-cadd-446c-97ea-1960693c09ba tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:39.525000 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-e0d0a9fd-ee07-4267-ba6b-a76744dcaa0c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:39.525658 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-e0d0a9fd-ee07-4267-ba6b-a76744dcaa0c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 4471f55c-7166-4321-b0ac-438ae8d3e5e2] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:39.535592 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e0d0a9fd-ee07-4267-ba6b-a76744dcaa0c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:39.536264 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e0d0a9fd-ee07-4267-ba6b-a76744dcaa0c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:39.537215 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e0d0a9fd-ee07-4267-ba6b-a76744dcaa0c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:39.538137 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e0d0a9fd-ee07-4267-ba6b-a76744dcaa0c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:39.601898 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-0aa77763-cadd-446c-97ea-1960693c09ba tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:39.631779 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-0aa77763-cadd-446c-97ea-1960693c09ba tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1623 microversion: 2.1 time: 0.165417 Jul 29 05:26:39.634809 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 377/716] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:39 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1623 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:39.757281 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-ac0339e4-2ed1-4340-9e7f-b82f78dfea2e tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:39.758243 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-ac0339e4-2ed1-4340-9e7f-b82f78dfea2e tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:39.802433 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ac0339e4-2ed1-4340-9e7f-b82f78dfea2e tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:39.803156 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ac0339e4-2ed1-4340-9e7f-b82f78dfea2e tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:39.814270 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-e0d0a9fd-ee07-4267-ba6b-a76744dcaa0c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:39.818497 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ac0339e4-2ed1-4340-9e7f-b82f78dfea2e tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:39.818952 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ac0339e4-2ed1-4340-9e7f-b82f78dfea2e tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:39.823823 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-e0d0a9fd-ee07-4267-ba6b-a76744dcaa0c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2" status: 200 len: 1681 microversion: 2.1 time: 0.302971 Jul 29 05:26:39.835461 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 340/717] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:39 2022] GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2 => generated 1681 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:26:40.106219 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-ac0339e4-2ed1-4340-9e7f-b82f78dfea2e tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:40.118829 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-ac0339e4-2ed1-4340-9e7f-b82f78dfea2e tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9" status: 200 len: 1363 microversion: 2.1 time: 0.365552 Jul 29 05:26:40.119912 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 378/718] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:39 2022] GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9 => generated 1363 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:26:40.544178 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-f3963ca2-8666-4f69-95c9-fc0574b3bade req-82adbc16-23f1-4079-935e-13c62d34cbfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4471f55c-7166-4321-b0ac-438ae8d3e5e2", "name": "network-vif-unplugged", "status": "completed", "tag": "cc0ff66d-f4e0-423a-a8ff-dc678b54c231"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:26:40.561571 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-f3963ca2-8666-4f69-95c9-fc0574b3bade req-82adbc16-23f1-4079-935e-13c62d34cbfd service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:40.562329 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-f3963ca2-8666-4f69-95c9-fc0574b3bade req-82adbc16-23f1-4079-935e-13c62d34cbfd service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:40.595832 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-f3963ca2-8666-4f69-95c9-fc0574b3bade req-82adbc16-23f1-4079-935e-13c62d34cbfd service nova] Creating event network-vif-unplugged:cc0ff66d-f4e0-423a-a8ff-dc678b54c231 for instance 4471f55c-7166-4321-b0ac-438ae8d3e5e2 on hv-cinder-85127 Jul 29 05:26:40.602527 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-f3963ca2-8666-4f69-95c9-fc0574b3bade req-82adbc16-23f1-4079-935e-13c62d34cbfd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063562 Jul 29 05:26:40.603932 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 341/719] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:26:40.678596 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-191f1bb2-19c5-47f3-a6d4-362e01d80473 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:40.680090 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-191f1bb2-19c5-47f3-a6d4-362e01d80473 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:40.690735 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-191f1bb2-19c5-47f3-a6d4-362e01d80473 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:40.691782 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-191f1bb2-19c5-47f3-a6d4-362e01d80473 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:40.693316 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-191f1bb2-19c5-47f3-a6d4-362e01d80473 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:40.694256 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-191f1bb2-19c5-47f3-a6d4-362e01d80473 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:40.749673 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-191f1bb2-19c5-47f3-a6d4-362e01d80473 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:40.751218 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-191f1bb2-19c5-47f3-a6d4-362e01d80473 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:40.751955 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.objects.instance [None req-191f1bb2-19c5-47f3-a6d4-362e01d80473 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lazy-loading 'fault' on Instance uuid 00171c99-cf39-4ed6-b78a-3bb24272b171 {{(pid=117821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:26:40.819115 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-191f1bb2-19c5-47f3-a6d4-362e01d80473 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:40.827954 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-191f1bb2-19c5-47f3-a6d4-362e01d80473 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 200 len: 1336 microversion: 2.1 time: 0.154170 Jul 29 05:26:40.829182 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 379/720] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:40 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 1336 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:40.853482 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-0d452e65-24a4-4897-a8fa-a3ee5d323f79 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:40.855215 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-0d452e65-24a4-4897-a8fa-a3ee5d323f79 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 4471f55c-7166-4321-b0ac-438ae8d3e5e2] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:40.866790 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0d452e65-24a4-4897-a8fa-a3ee5d323f79 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:40.867657 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0d452e65-24a4-4897-a8fa-a3ee5d323f79 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:40.868875 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0d452e65-24a4-4897-a8fa-a3ee5d323f79 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:40.869566 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0d452e65-24a4-4897-a8fa-a3ee5d323f79 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:41.157751 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-755c3720-7011-49b4-9901-45568c1ffe6e tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:41.158168 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-755c3720-7011-49b4-9901-45568c1ffe6e tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:41.176175 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-755c3720-7011-49b4-9901-45568c1ffe6e tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:41.177740 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-755c3720-7011-49b4-9901-45568c1ffe6e tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:41.179712 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-755c3720-7011-49b4-9901-45568c1ffe6e tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:41.180698 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-755c3720-7011-49b4-9901-45568c1ffe6e tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:41.239367 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-0d452e65-24a4-4897-a8fa-a3ee5d323f79 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:41.270585 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-0d452e65-24a4-4897-a8fa-a3ee5d323f79 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2" status: 200 len: 1681 microversion: 2.1 time: 0.423820 Jul 29 05:26:41.272209 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 342/721] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:40 2022] GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2 => generated 1681 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:41.391600 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-755c3720-7011-49b4-9901-45568c1ffe6e tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:41.400702 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-755c3720-7011-49b4-9901-45568c1ffe6e tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9" status: 200 len: 1548 microversion: 2.1 time: 0.248143 Jul 29 05:26:41.416187 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 380/722] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:41 2022] GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9 => generated 1548 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:41.423068 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-26a6b2c2-9506-4b93-a3a2-59ada7f874ec tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:41.423601 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-26a6b2c2-9506-4b93-a3a2-59ada7f874ec tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:41.430928 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-26a6b2c2-9506-4b93-a3a2-59ada7f874ec tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:41.431398 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-26a6b2c2-9506-4b93-a3a2-59ada7f874ec tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:41.432384 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-26a6b2c2-9506-4b93-a3a2-59ada7f874ec tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:41.432835 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-26a6b2c2-9506-4b93-a3a2-59ada7f874ec tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:41.563604 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-26a6b2c2-9506-4b93-a3a2-59ada7f874ec tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.144129 Jul 29 05:26:41.565079 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 343/723] 10.222.0.49 () {58 vars in 1275 bytes} [Fri Jul 29 05:26:41 2022] GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9/os-interface => generated 284 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:26:41.868533 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-3de25ced-dc44-4ca3-a74c-481115bc26a0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:41.870868 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-3de25ced-dc44-4ca3-a74c-481115bc26a0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 00171c99-cf39-4ed6-b78a-3bb24272b171] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:41.893578 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:26:41.898868 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3de25ced-dc44-4ca3-a74c-481115bc26a0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:41.899394 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3de25ced-dc44-4ca3-a74c-481115bc26a0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:41.902002 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3de25ced-dc44-4ca3-a74c-481115bc26a0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:41.902453 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3de25ced-dc44-4ca3-a74c-481115bc26a0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:41.929301 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.wsgi [None req-3de25ced-dc44-4ca3-a74c-481115bc26a0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] HTTP exception thrown: Instance 00171c99-cf39-4ed6-b78a-3bb24272b171 could not be found. Jul 29 05:26:41.931214 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-3de25ced-dc44-4ca3-a74c-481115bc26a0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Request method failure captured: Jul 29 05:26:41.931214 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: request: GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 HTTP/1.1 Jul 29 05:26:41.931214 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept: application/json Jul 29 05:26:41.931214 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept-Encoding: identity Jul 29 05:26:41.931214 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Connection: close Jul 29 05:26:41.931214 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Length: 0 Jul 29 05:26:41.931214 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Type: application/json Jul 29 05:26:41.931214 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Host: 10.222.0.49 Jul 29 05:26:41.931214 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Openstack-System-Scope: None Jul 29 05:26:41.931214 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: User-Agent: python-urllib3/1.26.10 Jul 29 05:26:41.931214 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Auth-Token: gAAAAABi425NDze3MZ6r1VD0FCYdq0OmQOLp-a8UlwTMNu4OjL5RkBuPvg1CcwPwgOttOt-6wL5UPCvTmDT4dvtmSR2MiB9UhU4F3cFaVbG964PhwtxReJ17pRKIo-RqoKvGgdruft6DgwjaYgOO11XCIKmUEetc8GovjBVxuznVeh-B9PpnvOw Jul 29 05:26:41.931214 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Id: None Jul 29 05:26:41.931214 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Name: None Jul 29 05:26:41.931214 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Identity-Status: Confirmed Jul 29 05:26:41.931214 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Is-Admin-Project: True Jul 29 05:26:41.931214 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Id: default Jul 29 05:26:41.931214 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Name: Default Jul 29 05:26:41.931214 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Id: 153fe5d9d64346f6b7419eba91948678 Jul 29 05:26:41.931214 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1077257590 Jul 29 05:26:41.931214 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Role: member,reader Jul 29 05:26:41.931214 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Roles: member,reader Jul 29 05:26:41.932999 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/153fe5d9d64346f6b7419eba91948678"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/153fe5d9d64346f6b7419eba91948678"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_153fe5d9d64346f6b7419eba91948678"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/153fe5d9d64346f6b7419eba91948678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:26:41.932999 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1077257590 Jul 29 05:26:41.932999 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Id: 153fe5d9d64346f6b7419eba91948678 Jul 29 05:26:41.932999 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1077257590 Jul 29 05:26:41.932999 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User: tempest-ServerRescueNegativeTestJSON-1077257590-project Jul 29 05:26:41.932999 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Id: default Jul 29 05:26:41.932999 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Name: Default Jul 29 05:26:41.932999 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Id: 45ae88234e984149be8539757efa8733 Jul 29 05:26:41.932999 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1077257590-project Jul 29 05:26:41.932999 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: method: > Jul 29 05:26:41.932999 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: exception: Instance 00171c99-cf39-4ed6-b78a-3bb24272b171 could not be found. Jul 29 05:26:41.932999 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: action_args: {'id': '00171c99-cf39-4ed6-b78a-3bb24272b171'} Jul 29 05:26:41.933942 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:26:41.933942 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:26:41.933942 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:26:41.933942 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:26:41.933942 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:26:41.933942 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:26:41.933942 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:26:41.933942 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:26:41.933942 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:26:41.933942 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:26:41.933942 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00171c99-cf39-4ed6-b78a-3bb24272b171 could not be found. Jul 29 05:26:41.933942 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:26:41.933942 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:26:41.933942 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:26:41.933942 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:26:41.933942 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:26:41.933942 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:26:41.933942 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:26:41.933942 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:26:41.933942 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:26:41.935525 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:26:41.935525 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:26:41.935525 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:26:41.935525 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:26:41.935525 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:26:41.935525 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:26:41.935525 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:26:41.935525 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00171c99-cf39-4ed6-b78a-3bb24272b171 could not be found. Jul 29 05:26:41.935525 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:26:41.935525 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:26:41.935525 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:26:41.935525 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:26:41.935525 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:26:41.935525 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:26:41.935525 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:26:41.935525 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:26:41.935525 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00171c99-cf39-4ed6-b78a-3bb24272b171 could not be found. Jul 29 05:26:41.935525 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:26:41.938045 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-3de25ced-dc44-4ca3-a74c-481115bc26a0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Returning 404 to user: Instance 00171c99-cf39-4ed6-b78a-3bb24272b171 could not be found. {{(pid=117821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:26:41.938045 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-3de25ced-dc44-4ca3-a74c-481115bc26a0 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171" status: 404 len: 111 microversion: 2.1 time: 0.089877 Jul 29 05:26:41.938045 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 381/724] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:41 2022] GET /compute/v2.1/servers/00171c99-cf39-4ed6-b78a-3bb24272b171 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:26:41.964229 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-a8d83052-25fc-491f-b998-9100462e4049 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '.version_select at 0x7fa63ab79b80>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:41.992907 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-a8d83052-25fc-491f-b998-9100462e4049 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2135817251" status: 202 len: 0 microversion: 2.1 time: 0.040152 Jul 29 05:26:41.993734 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 344/725] 10.222.0.49 () {58 vars in 1221 bytes} [Fri Jul 29 05:26:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2135817251 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 05:26:42.294299 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-91f677ea-df83-4eee-8c30-833e3c12334f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:42.294929 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-91f677ea-df83-4eee-8c30-833e3c12334f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 4471f55c-7166-4321-b0ac-438ae8d3e5e2] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:42.302960 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-91f677ea-df83-4eee-8c30-833e3c12334f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:42.303443 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-91f677ea-df83-4eee-8c30-833e3c12334f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:42.308450 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-91f677ea-df83-4eee-8c30-833e3c12334f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:42.316179 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-91f677ea-df83-4eee-8c30-833e3c12334f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:42.688841 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-91f677ea-df83-4eee-8c30-833e3c12334f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:42.704252 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-91f677ea-df83-4eee-8c30-833e3c12334f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2" status: 200 len: 1614 microversion: 2.1 time: 0.412880 Jul 29 05:26:42.705120 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 382/726] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:42 2022] GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2 => generated 1614 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:43.231678 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-b82c551d-0c44-402b-9282-771df05dfa83 req-f18e6688-7cfe-496c-8b52-9684dc44b8be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4471f55c-7166-4321-b0ac-438ae8d3e5e2", "name": "network-vif-deleted", "tag": "cc0ff66d-f4e0-423a-a8ff-dc678b54c231"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:26:43.246212 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=2,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:26:43.269983 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-b82c551d-0c44-402b-9282-771df05dfa83 req-f18e6688-7cfe-496c-8b52-9684dc44b8be service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:43.270592 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-b82c551d-0c44-402b-9282-771df05dfa83 req-f18e6688-7cfe-496c-8b52-9684dc44b8be service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:43.297691 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-b82c551d-0c44-402b-9282-771df05dfa83 req-f18e6688-7cfe-496c-8b52-9684dc44b8be service nova] Creating event network-vif-deleted:cc0ff66d-f4e0-423a-a8ff-dc678b54c231 for instance 4471f55c-7166-4321-b0ac-438ae8d3e5e2 on hv-cinder-85127 Jul 29 05:26:43.311206 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-b82c551d-0c44-402b-9282-771df05dfa83 req-f18e6688-7cfe-496c-8b52-9684dc44b8be service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.327873 Jul 29 05:26:43.315714 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 345/727] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:26:43.733426 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-b94a3909-1470-46e1-b0d8-8a9dad170bfc tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:43.734799 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-b94a3909-1470-46e1-b0d8-8a9dad170bfc tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 4471f55c-7166-4321-b0ac-438ae8d3e5e2] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:43.745807 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b94a3909-1470-46e1-b0d8-8a9dad170bfc tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:43.754397 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b94a3909-1470-46e1-b0d8-8a9dad170bfc tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:43.755771 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b94a3909-1470-46e1-b0d8-8a9dad170bfc tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:43.757457 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b94a3909-1470-46e1-b0d8-8a9dad170bfc tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:43.778631 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.wsgi [None req-b94a3909-1470-46e1-b0d8-8a9dad170bfc tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] HTTP exception thrown: Instance 4471f55c-7166-4321-b0ac-438ae8d3e5e2 could not be found. Jul 29 05:26:43.780819 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-b94a3909-1470-46e1-b0d8-8a9dad170bfc tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Request method failure captured: Jul 29 05:26:43.780819 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: request: GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2 HTTP/1.1 Jul 29 05:26:43.780819 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept: application/json Jul 29 05:26:43.780819 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept-Encoding: identity Jul 29 05:26:43.780819 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Connection: close Jul 29 05:26:43.780819 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Length: 0 Jul 29 05:26:43.780819 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Type: application/json Jul 29 05:26:43.780819 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Host: 10.222.0.49 Jul 29 05:26:43.780819 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Openstack-System-Scope: None Jul 29 05:26:43.780819 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: User-Agent: python-urllib3/1.26.10 Jul 29 05:26:43.780819 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Auth-Token: gAAAAABi425JZwki5zTQDTC3iukDv4VCbNzlxQK73dr9mClVYcp-Pvpl82CYunlqvLixJfXv6lMCmXCQFs-hx71b40CIPEvZNAkIclM8nEjPEEMC1q8Qnidc9zW9MB-6S0Nkj4s67ZnGkNw0VjcX1sLTyzzsa2KGY_dj5NlUwZaoPl1fActyKvM Jul 29 05:26:43.780819 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Id: None Jul 29 05:26:43.780819 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Name: None Jul 29 05:26:43.780819 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Identity-Status: Confirmed Jul 29 05:26:43.780819 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Is-Admin-Project: True Jul 29 05:26:43.780819 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Id: default Jul 29 05:26:43.780819 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Name: Default Jul 29 05:26:43.780819 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Id: 9d8baaf2e23546ee8ed1de278617c7d2 Jul 29 05:26:43.780819 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Name: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:26:43.780819 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Role: member,reader Jul 29 05:26:43.780819 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Roles: member,reader Jul 29 05:26:43.782743 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:26:43.782743 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:26:43.782743 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Id: 9d8baaf2e23546ee8ed1de278617c7d2 Jul 29 05:26:43.782743 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:26:43.782743 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User: tempest-AttachVolumeNegativeTest-480684510-project Jul 29 05:26:43.782743 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Id: default Jul 29 05:26:43.782743 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Name: Default Jul 29 05:26:43.782743 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Id: 3c60b3a983f14f50b1b762a3954a1059 Jul 29 05:26:43.782743 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Name: tempest-AttachVolumeNegativeTest-480684510-project Jul 29 05:26:43.782743 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: method: > Jul 29 05:26:43.782743 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: exception: Instance 4471f55c-7166-4321-b0ac-438ae8d3e5e2 could not be found. Jul 29 05:26:43.782743 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: action_args: {'id': '4471f55c-7166-4321-b0ac-438ae8d3e5e2'} Jul 29 05:26:43.783517 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:26:43.783517 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:26:43.783517 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:26:43.783517 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:26:43.783517 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:26:43.783517 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:26:43.783517 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:26:43.783517 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:26:43.783517 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:26:43.783517 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:26:43.783517 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4471f55c-7166-4321-b0ac-438ae8d3e5e2 could not be found. Jul 29 05:26:43.783517 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:26:43.783517 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:26:43.783517 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:26:43.783517 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:26:43.783517 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:26:43.783517 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:26:43.783517 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:26:43.783517 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:26:43.783517 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:26:43.784709 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:26:43.784709 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:26:43.784709 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:26:43.784709 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:26:43.784709 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:26:43.784709 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:26:43.784709 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:26:43.784709 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4471f55c-7166-4321-b0ac-438ae8d3e5e2 could not be found. Jul 29 05:26:43.784709 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:26:43.784709 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:26:43.784709 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:26:43.784709 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:26:43.784709 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:26:43.784709 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:26:43.784709 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:26:43.784709 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:26:43.784709 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4471f55c-7166-4321-b0ac-438ae8d3e5e2 could not be found. Jul 29 05:26:43.784709 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:26:43.787627 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-b94a3909-1470-46e1-b0d8-8a9dad170bfc tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Returning 404 to user: Instance 4471f55c-7166-4321-b0ac-438ae8d3e5e2 could not be found. {{(pid=117821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:26:43.788959 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-b94a3909-1470-46e1-b0d8-8a9dad170bfc tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2" status: 404 len: 111 microversion: 2.1 time: 0.061273 Jul 29 05:26:43.808495 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 383/728] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:43 2022] GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:26:43.821009 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-4839774c-70e3-42bc-a3ec-8f5a68de7fee tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '.version_select at 0x7fa63ab71f70>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:43.911074 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-4839774c-70e3-42bc-a3ec-8f5a68de7fee tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1673634664" status: 202 len: 0 microversion: 2.1 time: 0.104748 Jul 29 05:26:43.911874 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 346/729] 10.222.0.49 () {58 vars in 1221 bytes} [Fri Jul 29 05:26:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1673634664 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 05:26:45.073635 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-553d2a70-0087-463f-a021-7d7202bd5431 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Action: 'create', calling method: .version_select at 0x7fa63ac2d790>, body: {"keypair": {"name": "tempest-keypair-39188921", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKy8z5+qlgNMdencOqqaxI0iBctqRsYy2eU4IH7mlPAR2vA9sCJbwea6WqfgPDIp1wVdmkZVQwymDM3IYl9aC0xPJGkPgu5+VOuC4+3Kh4UPYTmc6WgPxMi9x9DAOgsaSw=="}} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:26:45.110271 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.quota [None req-553d2a70-0087-463f-a021-7d7202bd5431 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Getting quotas for project 9d8baaf2e23546ee8ed1de278617c7d2. Resources: {'key_pairs'} {{(pid=117821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:26:45.115220 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.quota [None req-553d2a70-0087-463f-a021-7d7202bd5431 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Getting quotas for user 3c60b3a983f14f50b1b762a3954a1059 and project 9d8baaf2e23546ee8ed1de278617c7d2. Resources: {'key_pairs'} {{(pid=117821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:26:45.150723 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-553d2a70-0087-463f-a021-7d7202bd5431 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.087437 Jul 29 05:26:45.158799 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 384/730] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Jul 29 05:26:45 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:26:45.354707 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-4a5df345-a0ca-4221-9d2e-c89abeb1ea9b req-b753f6b6-bd7b-424a-8484-25a5a36a9b1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62613145-ee65-4472-a5f6-23a6d76ea1b9", "tag": "a7825eab-725a-4a03-8c38-040b1712a57c"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:26:45.394159 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-4a5df345-a0ca-4221-9d2e-c89abeb1ea9b req-b753f6b6-bd7b-424a-8484-25a5a36a9b1c service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:45.394637 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-4a5df345-a0ca-4221-9d2e-c89abeb1ea9b req-b753f6b6-bd7b-424a-8484-25a5a36a9b1c service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:45.438470 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-4a5df345-a0ca-4221-9d2e-c89abeb1ea9b req-b753f6b6-bd7b-424a-8484-25a5a36a9b1c service nova] Creating event network-changed:a7825eab-725a-4a03-8c38-040b1712a57c for instance 62613145-ee65-4472-a5f6-23a6d76ea1b9 on hv-cinder-85127 Jul 29 05:26:45.452295 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-4a5df345-a0ca-4221-9d2e-c89abeb1ea9b req-b753f6b6-bd7b-424a-8484-25a5a36a9b1c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096742 Jul 29 05:26:45.454158 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 347/731] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:26:46.124392 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-67320439-6265-4976-bbb6-cb64c17c634e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:46.126557 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-67320439-6265-4976-bbb6-cb64c17c634e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:46.149233 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-67320439-6265-4976-bbb6-cb64c17c634e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:46.149692 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-67320439-6265-4976-bbb6-cb64c17c634e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:46.150488 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-67320439-6265-4976-bbb6-cb64c17c634e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:46.154918 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-67320439-6265-4976-bbb6-cb64c17c634e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:46.200771 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-67320439-6265-4976-bbb6-cb64c17c634e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Going to try to terminate instance {{(pid=117821) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 05:26:46.347714 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-67320439-6265-4976-bbb6-cb64c17c634e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 204 len: 0 microversion: 2.1 time: 0.229956 Jul 29 05:26:46.348748 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 385/732] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 05:26:46 2022] DELETE /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 05:26:46.360157 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-0bf56040-c4a3-49a7-be55-d5bc369349b9 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:46.361751 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-0bf56040-c4a3-49a7-be55-d5bc369349b9 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:46.371550 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0bf56040-c4a3-49a7-be55-d5bc369349b9 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:46.372318 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0bf56040-c4a3-49a7-be55-d5bc369349b9 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:46.373288 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0bf56040-c4a3-49a7-be55-d5bc369349b9 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:46.373897 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0bf56040-c4a3-49a7-be55-d5bc369349b9 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:46.552992 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-0bf56040-c4a3-49a7-be55-d5bc369349b9 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:46.579889 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-0bf56040-c4a3-49a7-be55-d5bc369349b9 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1507 microversion: 2.1 time: 0.225773 Jul 29 05:26:46.581410 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 348/733] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:46 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1507 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:47.225418 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-e7b730e8-4920-4d07-9290-f9ba23d4b3c9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1358007606", "imageRef": "b7bf870d-4e7c-42fd-849f-72ac19277493", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b55efc63-6791-470d-af15-935a2f0fc83e"}], "security_groups": [{"name": "tempest-securitygroup--400095429"}], "key_name": "tempest-keypair-39188921", "user_data": "}} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:26:47.391657 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.network.neutron [None req-e7b730e8-4920-4d07-9290-f9ba23d4b3c9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] validate_networks() for [('b55efc63-6791-470d-af15-935a2f0fc83e', None, None, None, None, None)] {{(pid=117821) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 05:26:47.603861 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-577b3c69-c40b-4238-8cfb-2a1c148aa220 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:47.604535 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-577b3c69-c40b-4238-8cfb-2a1c148aa220 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:47.613018 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-577b3c69-c40b-4238-8cfb-2a1c148aa220 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:47.614445 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-577b3c69-c40b-4238-8cfb-2a1c148aa220 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:47.614445 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-577b3c69-c40b-4238-8cfb-2a1c148aa220 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:47.614685 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-577b3c69-c40b-4238-8cfb-2a1c148aa220 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:47.624525 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:26:47.782244 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-577b3c69-c40b-4238-8cfb-2a1c148aa220 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:47.799887 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-577b3c69-c40b-4238-8cfb-2a1c148aa220 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1507 microversion: 2.1 time: 0.200856 Jul 29 05:26:47.800917 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 349/734] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:47 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1507 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:26:47.815652 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-1ac5880f-1d81-4209-8b24-6ac9c3dbe364 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Action: 'create', calling method: .version_select at 0x7fa63ac36f70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1818279114", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJe02FlV3PyY4DU6N0+iUEAkzyWzaSGNJODPEZe8BNwG335eT6vbaGHMvKxL3s5YB0FfeyPuz5jfoIWVM+bHhX8rY7Za+Mb8A0KCQjCHMdnOs13gvh7Uh+Wf+3VB44ig9Q=="}} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:26:47.831212 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.quota [None req-1ac5880f-1d81-4209-8b24-6ac9c3dbe364 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Getting quotas for project 4c28b78169ac49a6854f195bea0dd9bf. Resources: {'key_pairs'} {{(pid=117820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:26:47.837238 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.quota [None req-1ac5880f-1d81-4209-8b24-6ac9c3dbe364 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Getting quotas for user 190f6130be544a73bb619f7b49ab4e87 and project 4c28b78169ac49a6854f195bea0dd9bf. Resources: {'key_pairs'} {{(pid=117820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:26:47.870261 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-e7b730e8-4920-4d07-9290-f9ba23d4b3c9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Flavor limits 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 05:26:47.870757 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-e7b730e8-4920-4d07-9290-f9ba23d4b3c9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Image limits 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 05:26:47.871244 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-e7b730e8-4920-4d07-9290-f9ba23d4b3c9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Flavor pref 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 05:26:47.871805 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-e7b730e8-4920-4d07-9290-f9ba23d4b3c9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Image pref 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 05:26:47.872359 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-e7b730e8-4920-4d07-9290-f9ba23d4b3c9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 05:26:47.876801 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-1ac5880f-1d81-4209-8b24-6ac9c3dbe364 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.073426 Jul 29 05:26:47.877834 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 350/735] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Jul 29 05:26:47 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:26:47.886558 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e7b730e8-4920-4d07-9290-f9ba23d4b3c9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:47.887292 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e7b730e8-4920-4d07-9290-f9ba23d4b3c9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:47.888300 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e7b730e8-4920-4d07-9290-f9ba23d4b3c9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:47.888990 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e7b730e8-4920-4d07-9290-f9ba23d4b3c9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:47.914748 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.quota [None req-e7b730e8-4920-4d07-9290-f9ba23d4b3c9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Getting quotas for project 9d8baaf2e23546ee8ed1de278617c7d2. Resources: {'instances', 'ram', 'cores'} {{(pid=117821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:26:47.919597 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.quota [None req-e7b730e8-4920-4d07-9290-f9ba23d4b3c9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Getting quotas for user 3c60b3a983f14f50b1b762a3954a1059 and project 9d8baaf2e23546ee8ed1de278617c7d2. Resources: {'instances', 'ram', 'cores'} {{(pid=117821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:26:47.932213 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-01da68d2-b716-41a0-9512-dc2acb2a6af9 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-733162500", "imageRef": "f25b16ce-4d91-4398-9641-fd8741a4eb18", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1818279114", "networks": [{"uuid": "fbc0aa89-ee8e-4e90-b085-d635259d746e"}]}} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:26:47.934132 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-e7b730e8-4920-4d07-9290-f9ba23d4b3c9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Going to run 1 instances... {{(pid=117821) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 05:26:47.936675 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-e7b730e8-4920-4d07-9290-f9ba23d4b3c9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: c7d28599-67a9-4e84-a44d-79f1a6bf728f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b7bf870d-4e7c-42fd-849f-72ac19277493',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117821) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 05:26:47.988833 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-e7b730e8-4920-4d07-9290-f9ba23d4b3c9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.769122 Jul 29 05:26:47.989484 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 386/736] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 05:26:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 29 05:26:47.992220 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.network.neutron [None req-01da68d2-b716-41a0-9512-dc2acb2a6af9 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] validate_networks() for [('fbc0aa89-ee8e-4e90-b085-d635259d746e', None, None, None, None, None)] {{(pid=117820) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 05:26:48.004900 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-d1c8e648-330d-4d6a-bd58-776b1f8edc15 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:48.005634 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-d1c8e648-330d-4d6a-bd58-776b1f8edc15 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: c7d28599-67a9-4e84-a44d-79f1a6bf728f] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:48.067905 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-d1c8e648-330d-4d6a-bd58-776b1f8edc15 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:48.075730 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-d1c8e648-330d-4d6a-bd58-776b1f8edc15 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f" status: 200 len: 1240 microversion: 2.1 time: 0.074652 Jul 29 05:26:48.076731 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 387/737] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:47 2022] GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f => generated 1240 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:48.502926 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-01da68d2-b716-41a0-9512-dc2acb2a6af9 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Flavor limits 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 05:26:48.503372 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-01da68d2-b716-41a0-9512-dc2acb2a6af9 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Image limits 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 05:26:48.503870 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-01da68d2-b716-41a0-9512-dc2acb2a6af9 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Flavor pref 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 05:26:48.504284 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-01da68d2-b716-41a0-9512-dc2acb2a6af9 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Image pref 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 05:26:48.504851 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-01da68d2-b716-41a0-9512-dc2acb2a6af9 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 05:26:48.516597 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-01da68d2-b716-41a0-9512-dc2acb2a6af9 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:48.516597 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-01da68d2-b716-41a0-9512-dc2acb2a6af9 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:48.517333 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-01da68d2-b716-41a0-9512-dc2acb2a6af9 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:48.517793 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-01da68d2-b716-41a0-9512-dc2acb2a6af9 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:48.538084 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.quota [None req-01da68d2-b716-41a0-9512-dc2acb2a6af9 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Getting quotas for project 4c28b78169ac49a6854f195bea0dd9bf. Resources: {'instances', 'ram', 'cores'} {{(pid=117820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:26:48.543148 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.quota [None req-01da68d2-b716-41a0-9512-dc2acb2a6af9 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Getting quotas for user 190f6130be544a73bb619f7b49ab4e87 and project 4c28b78169ac49a6854f195bea0dd9bf. Resources: {'instances', 'ram', 'cores'} {{(pid=117820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:26:48.555721 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-01da68d2-b716-41a0-9512-dc2acb2a6af9 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Going to run 1 instances... {{(pid=117820) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 05:26:48.558043 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-01da68d2-b716-41a0-9512-dc2acb2a6af9 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f25b16ce-4d91-4398-9641-fd8741a4eb18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117820) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 05:26:48.610427 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-01da68d2-b716-41a0-9512-dc2acb2a6af9 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.681914 Jul 29 05:26:48.612879 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 351/738] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 05:26:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 29 05:26:48.625517 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-ec8661d0-5c61-430e-915e-6741bb962b56 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:48.626142 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-ec8661d0-5c61-430e-915e-6741bb962b56 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:48.706082 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-ec8661d0-5c61-430e-915e-6741bb962b56 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:48.715294 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-ec8661d0-5c61-430e-915e-6741bb962b56 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1258 microversion: 2.1 time: 0.095412 Jul 29 05:26:48.716148 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 388/739] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:48 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1258 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:48.835294 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-efb25a67-65b6-4f98-ba86-f6e1c2af9188 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:48.836663 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-efb25a67-65b6-4f98-ba86-f6e1c2af9188 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:48.848170 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-efb25a67-65b6-4f98-ba86-f6e1c2af9188 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:48.849300 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-efb25a67-65b6-4f98-ba86-f6e1c2af9188 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:48.850373 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-efb25a67-65b6-4f98-ba86-f6e1c2af9188 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:48.850768 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-efb25a67-65b6-4f98-ba86-f6e1c2af9188 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:49.095218 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-efb25a67-65b6-4f98-ba86-f6e1c2af9188 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:49.098399 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-7c1f18f8-7fe2-4740-a67e-0d0a19651048 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:49.099487 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-7c1f18f8-7fe2-4740-a67e-0d0a19651048 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: c7d28599-67a9-4e84-a44d-79f1a6bf728f] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:49.107038 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-efb25a67-65b6-4f98-ba86-f6e1c2af9188 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1507 microversion: 2.1 time: 0.281528 Jul 29 05:26:49.113012 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7c1f18f8-7fe2-4740-a67e-0d0a19651048 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:49.114592 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7c1f18f8-7fe2-4740-a67e-0d0a19651048 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:49.116365 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7c1f18f8-7fe2-4740-a67e-0d0a19651048 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:49.117369 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7c1f18f8-7fe2-4740-a67e-0d0a19651048 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:49.122615 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 352/740] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:48 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1507 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:26:49.225099 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-7c1f18f8-7fe2-4740-a67e-0d0a19651048 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:49.246467 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-7c1f18f8-7fe2-4740-a67e-0d0a19651048 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f" status: 200 len: 1292 microversion: 2.1 time: 0.149059 Jul 29 05:26:49.248184 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 389/741] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:49 2022] GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f => generated 1292 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:26:49.750823 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-37f0c829-b044-4ce1-941a-d12c3eb0efbe tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:49.751688 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-37f0c829-b044-4ce1-941a-d12c3eb0efbe tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:49.758634 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-37f0c829-b044-4ce1-941a-d12c3eb0efbe tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:49.758880 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-8dc96a62-3626-4b73-8cc9-dc5b8b659423 req-dab9935d-90e6-484b-bea4-298e142b46f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6c67286-4bb1-4dc6-87ba-4c21f3ff863a", "name": "network-vif-deleted", "tag": "6bc36d89-d1c5-4873-87c6-12b89c984f37"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:26:49.761769 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-37f0c829-b044-4ce1-941a-d12c3eb0efbe tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:49.761769 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-37f0c829-b044-4ce1-941a-d12c3eb0efbe tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:49.761769 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-37f0c829-b044-4ce1-941a-d12c3eb0efbe tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:49.770867 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-8dc96a62-3626-4b73-8cc9-dc5b8b659423 req-dab9935d-90e6-484b-bea4-298e142b46f7 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:49.771334 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-8dc96a62-3626-4b73-8cc9-dc5b8b659423 req-dab9935d-90e6-484b-bea4-298e142b46f7 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:49.787032 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-8dc96a62-3626-4b73-8cc9-dc5b8b659423 req-dab9935d-90e6-484b-bea4-298e142b46f7 service nova] Creating event network-vif-deleted:6bc36d89-d1c5-4873-87c6-12b89c984f37 for instance a6c67286-4bb1-4dc6-87ba-4c21f3ff863a on hv-cinder-85127 Jul 29 05:26:49.802814 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-8dc96a62-3626-4b73-8cc9-dc5b8b659423 req-dab9935d-90e6-484b-bea4-298e142b46f7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048450 Jul 29 05:26:49.806775 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 390/742] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:26:49.933646 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-37f0c829-b044-4ce1-941a-d12c3eb0efbe tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:49.944451 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-37f0c829-b044-4ce1-941a-d12c3eb0efbe tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1310 microversion: 2.1 time: 0.198537 Jul 29 05:26:49.945286 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 353/743] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:49 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1310 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:50.129900 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-256c9254-79b6-42a5-885a-3b664353b301 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:50.130875 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-256c9254-79b6-42a5-885a-3b664353b301 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:50.139340 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-256c9254-79b6-42a5-885a-3b664353b301 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:50.141966 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-256c9254-79b6-42a5-885a-3b664353b301 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:50.142882 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-256c9254-79b6-42a5-885a-3b664353b301 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:50.143341 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-256c9254-79b6-42a5-885a-3b664353b301 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:50.188509 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-256c9254-79b6-42a5-885a-3b664353b301 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:50.189287 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-256c9254-79b6-42a5-885a-3b664353b301 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:50.189988 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.objects.instance [None req-256c9254-79b6-42a5-885a-3b664353b301 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lazy-loading 'fault' on Instance uuid a6c67286-4bb1-4dc6-87ba-4c21f3ff863a {{(pid=117821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:26:50.248517 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-256c9254-79b6-42a5-885a-3b664353b301 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:50.263047 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-256c9254-79b6-42a5-885a-3b664353b301 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 200 len: 1311 microversion: 2.1 time: 0.137847 Jul 29 05:26:50.291062 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-b8a4605e-1591-495e-9d87-4240ffc6a666 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:50.295617 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-b8a4605e-1591-495e-9d87-4240ffc6a666 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: c7d28599-67a9-4e84-a44d-79f1a6bf728f] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:50.313561 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 391/744] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:50 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 1311 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:50.314334 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b8a4605e-1591-495e-9d87-4240ffc6a666 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:50.314334 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b8a4605e-1591-495e-9d87-4240ffc6a666 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:50.314334 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b8a4605e-1591-495e-9d87-4240ffc6a666 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:50.314334 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b8a4605e-1591-495e-9d87-4240ffc6a666 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:50.455657 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-b8a4605e-1591-495e-9d87-4240ffc6a666 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:50.463420 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-b8a4605e-1591-495e-9d87-4240ffc6a666 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f" status: 200 len: 1298 microversion: 2.1 time: 0.189656 Jul 29 05:26:50.478434 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 354/745] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:50 2022] GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f => generated 1298 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:50.967827 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-80aa40c7-d23d-4bd1-adb7-ea10ecc0460a tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:50.969716 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-80aa40c7-d23d-4bd1-adb7-ea10ecc0460a tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:50.986466 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-80aa40c7-d23d-4bd1-adb7-ea10ecc0460a tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:50.989614 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-80aa40c7-d23d-4bd1-adb7-ea10ecc0460a tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:50.990781 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-80aa40c7-d23d-4bd1-adb7-ea10ecc0460a tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:50.992785 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-80aa40c7-d23d-4bd1-adb7-ea10ecc0460a tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:51.134660 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-80aa40c7-d23d-4bd1-adb7-ea10ecc0460a tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:51.143972 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-80aa40c7-d23d-4bd1-adb7-ea10ecc0460a tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1316 microversion: 2.1 time: 0.181581 Jul 29 05:26:51.144677 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 392/746] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:50 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1316 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:51.322195 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-81c36406-6963-4d82-a793-a45a6cbd9c7a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:51.324075 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-81c36406-6963-4d82-a793-a45a6cbd9c7a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: a6c67286-4bb1-4dc6-87ba-4c21f3ff863a] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:51.332629 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-81c36406-6963-4d82-a793-a45a6cbd9c7a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:51.333720 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-81c36406-6963-4d82-a793-a45a6cbd9c7a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:51.334800 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-81c36406-6963-4d82-a793-a45a6cbd9c7a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:51.335678 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-81c36406-6963-4d82-a793-a45a6cbd9c7a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:51.411607 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.wsgi [None req-81c36406-6963-4d82-a793-a45a6cbd9c7a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] HTTP exception thrown: Instance a6c67286-4bb1-4dc6-87ba-4c21f3ff863a could not be found. Jul 29 05:26:51.420214 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-81c36406-6963-4d82-a793-a45a6cbd9c7a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Request method failure captured: Jul 29 05:26:51.420214 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: request: GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a HTTP/1.1 Jul 29 05:26:51.420214 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept: application/json Jul 29 05:26:51.420214 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept-Encoding: identity Jul 29 05:26:51.420214 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Connection: close Jul 29 05:26:51.420214 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Length: 0 Jul 29 05:26:51.420214 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Type: application/json Jul 29 05:26:51.420214 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Host: 10.222.0.49 Jul 29 05:26:51.420214 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Openstack-System-Scope: None Jul 29 05:26:51.420214 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: User-Agent: python-urllib3/1.26.10 Jul 29 05:26:51.420214 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Auth-Token: gAAAAABi425NDze3MZ6r1VD0FCYdq0OmQOLp-a8UlwTMNu4OjL5RkBuPvg1CcwPwgOttOt-6wL5UPCvTmDT4dvtmSR2MiB9UhU4F3cFaVbG964PhwtxReJ17pRKIo-RqoKvGgdruft6DgwjaYgOO11XCIKmUEetc8GovjBVxuznVeh-B9PpnvOw Jul 29 05:26:51.420214 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Id: None Jul 29 05:26:51.420214 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Name: None Jul 29 05:26:51.420214 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Identity-Status: Confirmed Jul 29 05:26:51.420214 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Is-Admin-Project: True Jul 29 05:26:51.420214 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Id: default Jul 29 05:26:51.420214 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Name: Default Jul 29 05:26:51.420214 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Id: 153fe5d9d64346f6b7419eba91948678 Jul 29 05:26:51.420214 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1077257590 Jul 29 05:26:51.420214 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Role: member,reader Jul 29 05:26:51.420214 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Roles: member,reader Jul 29 05:26:51.422593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/153fe5d9d64346f6b7419eba91948678"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/153fe5d9d64346f6b7419eba91948678"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_153fe5d9d64346f6b7419eba91948678"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/153fe5d9d64346f6b7419eba91948678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:26:51.422593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1077257590 Jul 29 05:26:51.422593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Id: 153fe5d9d64346f6b7419eba91948678 Jul 29 05:26:51.422593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1077257590 Jul 29 05:26:51.422593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User: tempest-ServerRescueNegativeTestJSON-1077257590-project Jul 29 05:26:51.422593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Id: default Jul 29 05:26:51.422593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Name: Default Jul 29 05:26:51.422593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Id: 45ae88234e984149be8539757efa8733 Jul 29 05:26:51.422593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1077257590-project Jul 29 05:26:51.422593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: method: > Jul 29 05:26:51.422593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: exception: Instance a6c67286-4bb1-4dc6-87ba-4c21f3ff863a could not be found. Jul 29 05:26:51.422593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: action_args: {'id': 'a6c67286-4bb1-4dc6-87ba-4c21f3ff863a'} Jul 29 05:26:51.423491 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:26:51.423491 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:26:51.423491 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:26:51.423491 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:26:51.423491 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:26:51.423491 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:26:51.423491 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:26:51.423491 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:26:51.423491 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:26:51.423491 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:26:51.423491 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6c67286-4bb1-4dc6-87ba-4c21f3ff863a could not be found. Jul 29 05:26:51.423491 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:26:51.423491 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:26:51.423491 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:26:51.423491 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:26:51.423491 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:26:51.423491 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:26:51.423491 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:26:51.423491 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:26:51.423491 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:26:51.426427 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:26:51.426427 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:26:51.426427 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:26:51.426427 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:26:51.426427 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:26:51.426427 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:26:51.426427 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:26:51.426427 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6c67286-4bb1-4dc6-87ba-4c21f3ff863a could not be found. Jul 29 05:26:51.426427 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:26:51.426427 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:26:51.426427 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:26:51.426427 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:26:51.426427 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:26:51.426427 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:26:51.426427 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:26:51.426427 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:26:51.426427 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6c67286-4bb1-4dc6-87ba-4c21f3ff863a could not be found. Jul 29 05:26:51.426427 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:26:51.430786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-81c36406-6963-4d82-a793-a45a6cbd9c7a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Returning 404 to user: Instance a6c67286-4bb1-4dc6-87ba-4c21f3ff863a could not be found. {{(pid=117820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:26:51.431958 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-81c36406-6963-4d82-a793-a45a6cbd9c7a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a" status: 404 len: 111 microversion: 2.1 time: 0.115389 Jul 29 05:26:51.433466 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 355/747] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:51 2022] GET /compute/v2.1/servers/a6c67286-4bb1-4dc6-87ba-4c21f3ff863a => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:26:51.443790 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-7298e8f7-64aa-4d96-bec6-5a4e68d727b9 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:51.445149 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-7298e8f7-64aa-4d96-bec6-5a4e68d727b9 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:51.453659 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7298e8f7-64aa-4d96-bec6-5a4e68d727b9 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:51.456071 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7298e8f7-64aa-4d96-bec6-5a4e68d727b9 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:51.456997 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7298e8f7-64aa-4d96-bec6-5a4e68d727b9 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:51.457536 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7298e8f7-64aa-4d96-bec6-5a4e68d727b9 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:51.487991 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-9f5c1b6f-c29f-4aa3-b199-8db98b4f3269 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:51.488662 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-9f5c1b6f-c29f-4aa3-b199-8db98b4f3269 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: c7d28599-67a9-4e84-a44d-79f1a6bf728f] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:51.510900 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9f5c1b6f-c29f-4aa3-b199-8db98b4f3269 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:51.514404 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9f5c1b6f-c29f-4aa3-b199-8db98b4f3269 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:51.517277 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9f5c1b6f-c29f-4aa3-b199-8db98b4f3269 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:51.520574 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9f5c1b6f-c29f-4aa3-b199-8db98b4f3269 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:51.540365 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-7298e8f7-64aa-4d96-bec6-5a4e68d727b9 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Going to try to terminate instance {{(pid=117821) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 05:26:51.665107 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-7298e8f7-64aa-4d96-bec6-5a4e68d727b9 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 204 len: 0 microversion: 2.1 time: 0.225491 Jul 29 05:26:51.669459 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 393/748] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 05:26:51 2022] DELETE /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 05:26:51.676678 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-a3ce1c0e-8ce6-4741-be14-bb959c1d5872 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:51.677656 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-a3ce1c0e-8ce6-4741-be14-bb959c1d5872 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:51.684806 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a3ce1c0e-8ce6-4741-be14-bb959c1d5872 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:51.685651 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a3ce1c0e-8ce6-4741-be14-bb959c1d5872 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:51.686621 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a3ce1c0e-8ce6-4741-be14-bb959c1d5872 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:51.688192 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a3ce1c0e-8ce6-4741-be14-bb959c1d5872 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:51.720213 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:26:51.814989 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-9f5c1b6f-c29f-4aa3-b199-8db98b4f3269 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:51.824394 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-9f5c1b6f-c29f-4aa3-b199-8db98b4f3269 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f" status: 200 len: 1365 microversion: 2.1 time: 0.342037 Jul 29 05:26:51.827117 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 356/749] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:51 2022] GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f => generated 1365 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:51.976091 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-a3ce1c0e-8ce6-4741-be14-bb959c1d5872 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:51.994183 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-a3ce1c0e-8ce6-4741-be14-bb959c1d5872 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1523 microversion: 2.1 time: 0.322313 Jul 29 05:26:51.996981 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 394/750] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:51 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1523 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:52.166084 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-4ed7a00a-5b40-4186-aff5-7ec337b9a293 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:52.166825 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-4ed7a00a-5b40-4186-aff5-7ec337b9a293 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:52.177353 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-4ed7a00a-5b40-4186-aff5-7ec337b9a293 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:52.177900 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-4ed7a00a-5b40-4186-aff5-7ec337b9a293 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:52.178798 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-4ed7a00a-5b40-4186-aff5-7ec337b9a293 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:52.179463 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-4ed7a00a-5b40-4186-aff5-7ec337b9a293 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:52.510960 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-4ed7a00a-5b40-4186-aff5-7ec337b9a293 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:52.518855 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-4ed7a00a-5b40-4186-aff5-7ec337b9a293 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1358 microversion: 2.1 time: 0.356625 Jul 29 05:26:52.519724 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 357/751] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:52 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1358 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:52.856089 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-a3ea3656-5c74-477b-9807-c46b7067705f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:52.857310 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-a3ea3656-5c74-477b-9807-c46b7067705f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: c7d28599-67a9-4e84-a44d-79f1a6bf728f] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:52.865712 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a3ea3656-5c74-477b-9807-c46b7067705f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:52.866160 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a3ea3656-5c74-477b-9807-c46b7067705f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:52.866933 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a3ea3656-5c74-477b-9807-c46b7067705f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:52.867433 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a3ea3656-5c74-477b-9807-c46b7067705f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:53.021277 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-4d28322a-2b45-49ca-8ca8-f7532d8a038a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:53.021902 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-4d28322a-2b45-49ca-8ca8-f7532d8a038a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:53.029457 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-4d28322a-2b45-49ca-8ca8-f7532d8a038a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:53.029920 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-4d28322a-2b45-49ca-8ca8-f7532d8a038a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:53.031398 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-4d28322a-2b45-49ca-8ca8-f7532d8a038a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:53.031685 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-4d28322a-2b45-49ca-8ca8-f7532d8a038a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:53.040547 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-a3ea3656-5c74-477b-9807-c46b7067705f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:53.057394 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-a3ea3656-5c74-477b-9807-c46b7067705f tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f" status: 200 len: 1365 microversion: 2.1 time: 0.204907 Jul 29 05:26:53.058700 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 395/752] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:52 2022] GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f => generated 1365 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:53.181357 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-60e8d6bc-bc02-4b60-8de5-de9ae4033765 req-eaba82b8-bcc6-4ce2-b0eb-c3e2334c5e09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7d28599-67a9-4e84-a44d-79f1a6bf728f", "tag": "c7e12f70-c8c8-48ec-9fd7-5a69b095e812"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:26:53.200166 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-60e8d6bc-bc02-4b60-8de5-de9ae4033765 req-eaba82b8-bcc6-4ce2-b0eb-c3e2334c5e09 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:53.201008 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-60e8d6bc-bc02-4b60-8de5-de9ae4033765 req-eaba82b8-bcc6-4ce2-b0eb-c3e2334c5e09 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:53.217251 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-60e8d6bc-bc02-4b60-8de5-de9ae4033765 req-eaba82b8-bcc6-4ce2-b0eb-c3e2334c5e09 service nova] Creating event network-changed:c7e12f70-c8c8-48ec-9fd7-5a69b095e812 for instance c7d28599-67a9-4e84-a44d-79f1a6bf728f on hv-cinder-85127 Jul 29 05:26:53.223154 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-60e8d6bc-bc02-4b60-8de5-de9ae4033765 req-eaba82b8-bcc6-4ce2-b0eb-c3e2334c5e09 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045291 Jul 29 05:26:53.223910 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 396/753] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:26:53.339144 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-4d28322a-2b45-49ca-8ca8-f7532d8a038a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:53.349661 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-4d28322a-2b45-49ca-8ca8-f7532d8a038a tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1523 microversion: 2.1 time: 0.335409 Jul 29 05:26:53.350463 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 358/754] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:53 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1523 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:26:53.541365 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-b326ad47-1452-410f-b001-92032524b474 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:53.542070 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-b326ad47-1452-410f-b001-92032524b474 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:53.550073 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b326ad47-1452-410f-b001-92032524b474 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:53.550523 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b326ad47-1452-410f-b001-92032524b474 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:53.551301 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b326ad47-1452-410f-b001-92032524b474 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:53.551780 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b326ad47-1452-410f-b001-92032524b474 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:53.695241 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-b326ad47-1452-410f-b001-92032524b474 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:53.703770 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-b326ad47-1452-410f-b001-92032524b474 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1358 microversion: 2.1 time: 0.166736 Jul 29 05:26:53.704343 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 397/755] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:53 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:54.078737 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-a9188011-eb3b-4d72-bcda-f37364cb153e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:54.079509 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-a9188011-eb3b-4d72-bcda-f37364cb153e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: c7d28599-67a9-4e84-a44d-79f1a6bf728f] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:54.086737 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a9188011-eb3b-4d72-bcda-f37364cb153e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:54.087209 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a9188011-eb3b-4d72-bcda-f37364cb153e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:54.088076 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a9188011-eb3b-4d72-bcda-f37364cb153e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:54.088519 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a9188011-eb3b-4d72-bcda-f37364cb153e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:54.244643 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-a9188011-eb3b-4d72-bcda-f37364cb153e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:54.256254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-a9188011-eb3b-4d72-bcda-f37364cb153e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f" status: 200 len: 1365 microversion: 2.1 time: 0.181457 Jul 29 05:26:54.257830 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 359/756] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:54 2022] GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:54.371742 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-4d7510a2-9290-4496-976a-ed188465e122 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:54.372300 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-4d7510a2-9290-4496-976a-ed188465e122 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:54.381430 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4d7510a2-9290-4496-976a-ed188465e122 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:54.382254 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4d7510a2-9290-4496-976a-ed188465e122 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:54.383147 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4d7510a2-9290-4496-976a-ed188465e122 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:54.383830 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4d7510a2-9290-4496-976a-ed188465e122 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:54.597826 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-4d7510a2-9290-4496-976a-ed188465e122 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:54.608009 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-4d7510a2-9290-4496-976a-ed188465e122 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1523 microversion: 2.1 time: 0.240291 Jul 29 05:26:54.609437 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 398/757] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:54 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1523 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:54.726835 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-454097f9-9b80-4c48-ba17-8279da1291f3 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:54.727485 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-454097f9-9b80-4c48-ba17-8279da1291f3 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:54.735387 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-454097f9-9b80-4c48-ba17-8279da1291f3 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:54.735905 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-454097f9-9b80-4c48-ba17-8279da1291f3 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:54.737137 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-454097f9-9b80-4c48-ba17-8279da1291f3 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:54.737867 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-454097f9-9b80-4c48-ba17-8279da1291f3 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:54.921583 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-454097f9-9b80-4c48-ba17-8279da1291f3 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:54.929363 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-454097f9-9b80-4c48-ba17-8279da1291f3 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1358 microversion: 2.1 time: 0.207923 Jul 29 05:26:54.929935 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 360/758] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:54 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:55.241260 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-483d9718-7025-4802-82bf-ec6a0c811c30 req-1a7ff5e2-5e2c-4947-9dbb-d55e032e9bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8e59cc2-032c-497f-867c-2d5663a4da21", "tag": "6d8585cd-d0d9-4ae4-9146-299c453184a4"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:26:55.251825 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-483d9718-7025-4802-82bf-ec6a0c811c30 req-1a7ff5e2-5e2c-4947-9dbb-d55e032e9bc6 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:55.252387 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-483d9718-7025-4802-82bf-ec6a0c811c30 req-1a7ff5e2-5e2c-4947-9dbb-d55e032e9bc6 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:55.263729 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-483d9718-7025-4802-82bf-ec6a0c811c30 req-1a7ff5e2-5e2c-4947-9dbb-d55e032e9bc6 service nova] Creating event network-changed:6d8585cd-d0d9-4ae4-9146-299c453184a4 for instance a8e59cc2-032c-497f-867c-2d5663a4da21 on hv-cinder-85127 Jul 29 05:26:55.269040 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-483d9718-7025-4802-82bf-ec6a0c811c30 req-1a7ff5e2-5e2c-4947-9dbb-d55e032e9bc6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031475 Jul 29 05:26:55.269654 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 399/759] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:26:55.282701 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-e554607b-6b65-4d57-a6bc-a2934bcd2f17 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:55.283241 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-e554607b-6b65-4d57-a6bc-a2934bcd2f17 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: c7d28599-67a9-4e84-a44d-79f1a6bf728f] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:55.289395 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e554607b-6b65-4d57-a6bc-a2934bcd2f17 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:55.289843 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e554607b-6b65-4d57-a6bc-a2934bcd2f17 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:55.290604 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e554607b-6b65-4d57-a6bc-a2934bcd2f17 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:55.291044 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e554607b-6b65-4d57-a6bc-a2934bcd2f17 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:55.453346 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-e554607b-6b65-4d57-a6bc-a2934bcd2f17 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:55.460875 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-e554607b-6b65-4d57-a6bc-a2934bcd2f17 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f" status: 200 len: 1365 microversion: 2.1 time: 0.183680 Jul 29 05:26:55.461443 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 361/760] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:55 2022] GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:55.645055 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-1591be30-811c-4e07-8654-6c2f821447fe tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:55.645750 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-1591be30-811c-4e07-8654-6c2f821447fe tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:55.652897 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1591be30-811c-4e07-8654-6c2f821447fe tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:55.653338 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1591be30-811c-4e07-8654-6c2f821447fe tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:55.654099 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1591be30-811c-4e07-8654-6c2f821447fe tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:55.654529 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1591be30-811c-4e07-8654-6c2f821447fe tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:55.823589 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-1591be30-811c-4e07-8654-6c2f821447fe tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:55.835665 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-1591be30-811c-4e07-8654-6c2f821447fe tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1523 microversion: 2.1 time: 0.194238 Jul 29 05:26:55.836963 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 400/761] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:55 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1523 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:55.950646 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-038c4833-76e9-4a8e-8277-dfb1fd7d8e02 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:55.951196 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-038c4833-76e9-4a8e-8277-dfb1fd7d8e02 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:55.958101 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-038c4833-76e9-4a8e-8277-dfb1fd7d8e02 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:55.958549 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-038c4833-76e9-4a8e-8277-dfb1fd7d8e02 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:55.959335 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-038c4833-76e9-4a8e-8277-dfb1fd7d8e02 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:55.959800 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-038c4833-76e9-4a8e-8277-dfb1fd7d8e02 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:56.120170 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-038c4833-76e9-4a8e-8277-dfb1fd7d8e02 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:56.128702 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-038c4833-76e9-4a8e-8277-dfb1fd7d8e02 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1358 microversion: 2.1 time: 0.181973 Jul 29 05:26:56.129533 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 362/762] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:55 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:56.481467 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-6b8609aa-72a5-47cc-9c5d-98bd14df24f5 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:56.481973 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-6b8609aa-72a5-47cc-9c5d-98bd14df24f5 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: c7d28599-67a9-4e84-a44d-79f1a6bf728f] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:56.488719 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6b8609aa-72a5-47cc-9c5d-98bd14df24f5 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:56.489167 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6b8609aa-72a5-47cc-9c5d-98bd14df24f5 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:56.490015 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6b8609aa-72a5-47cc-9c5d-98bd14df24f5 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:56.490450 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6b8609aa-72a5-47cc-9c5d-98bd14df24f5 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:56.634067 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-6b8609aa-72a5-47cc-9c5d-98bd14df24f5 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:56.641883 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-6b8609aa-72a5-47cc-9c5d-98bd14df24f5 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f" status: 200 len: 1365 microversion: 2.1 time: 0.164276 Jul 29 05:26:56.642594 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 401/763] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:56 2022] GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:56.860938 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-78fb9a04-6b10-4fdd-b78c-0847df643c29 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:56.861524 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-78fb9a04-6b10-4fdd-b78c-0847df643c29 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:56.868022 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-78fb9a04-6b10-4fdd-b78c-0847df643c29 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:56.868481 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-78fb9a04-6b10-4fdd-b78c-0847df643c29 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:56.869267 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-78fb9a04-6b10-4fdd-b78c-0847df643c29 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:56.869774 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-78fb9a04-6b10-4fdd-b78c-0847df643c29 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:57.039075 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-78fb9a04-6b10-4fdd-b78c-0847df643c29 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:57.055504 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-78fb9a04-6b10-4fdd-b78c-0847df643c29 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1523 microversion: 2.1 time: 0.198436 Jul 29 05:26:57.057057 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 363/764] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:56 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:57.159821 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-77e27c31-b8e4-4a27-877e-a3389772d294 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:57.161296 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-77e27c31-b8e4-4a27-877e-a3389772d294 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:57.170136 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-77e27c31-b8e4-4a27-877e-a3389772d294 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:57.170762 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-77e27c31-b8e4-4a27-877e-a3389772d294 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:57.172393 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-77e27c31-b8e4-4a27-877e-a3389772d294 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:57.172909 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-77e27c31-b8e4-4a27-877e-a3389772d294 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:57.342564 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-77e27c31-b8e4-4a27-877e-a3389772d294 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:57.351697 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-77e27c31-b8e4-4a27-877e-a3389772d294 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1358 microversion: 2.1 time: 0.203751 Jul 29 05:26:57.352273 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 402/765] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:57 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:57.662861 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-0e26d07e-64ad-4556-a803-fd219db05d68 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:57.663490 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-0e26d07e-64ad-4556-a803-fd219db05d68 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: c7d28599-67a9-4e84-a44d-79f1a6bf728f] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:57.677091 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0e26d07e-64ad-4556-a803-fd219db05d68 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:57.677091 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0e26d07e-64ad-4556-a803-fd219db05d68 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:57.677091 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0e26d07e-64ad-4556-a803-fd219db05d68 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:57.677091 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0e26d07e-64ad-4556-a803-fd219db05d68 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:57.826358 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-0e26d07e-64ad-4556-a803-fd219db05d68 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:57.836711 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-0e26d07e-64ad-4556-a803-fd219db05d68 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f" status: 200 len: 1365 microversion: 2.1 time: 0.178246 Jul 29 05:26:57.837634 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 364/766] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:57 2022] GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:58.078388 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-cf9d7964-f6fb-4b69-a35f-bab6fb44831d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:58.078907 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-cf9d7964-f6fb-4b69-a35f-bab6fb44831d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:58.081813 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell0:SELECT=2 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:26:58.087794 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-cf9d7964-f6fb-4b69-a35f-bab6fb44831d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:58.088251 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-cf9d7964-f6fb-4b69-a35f-bab6fb44831d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:58.089135 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-cf9d7964-f6fb-4b69-a35f-bab6fb44831d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:58.089469 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-cf9d7964-f6fb-4b69-a35f-bab6fb44831d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:58.271793 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-cf9d7964-f6fb-4b69-a35f-bab6fb44831d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:58.280455 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-cf9d7964-f6fb-4b69-a35f-bab6fb44831d tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1523 microversion: 2.1 time: 0.205908 Jul 29 05:26:58.281501 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 403/767] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:58 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1523 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:58.376682 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-512e1266-7370-4968-b23e-c6a410b010cf tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:58.378180 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-512e1266-7370-4968-b23e-c6a410b010cf tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:58.385621 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-512e1266-7370-4968-b23e-c6a410b010cf tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:58.386465 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-512e1266-7370-4968-b23e-c6a410b010cf tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:58.387483 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-512e1266-7370-4968-b23e-c6a410b010cf tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:58.388112 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-512e1266-7370-4968-b23e-c6a410b010cf tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:58.527654 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell0:SELECT=2 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:26:58.551466 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell0:SELECT=10 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:26:58.583059 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-512e1266-7370-4968-b23e-c6a410b010cf tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:58.590877 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-512e1266-7370-4968-b23e-c6a410b010cf tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1358 microversion: 2.1 time: 0.218078 Jul 29 05:26:58.591535 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 365/768] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:58 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:58.863138 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-17c3fa65-0bdb-4a40-8c78-87881c15d301 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:58.863765 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-17c3fa65-0bdb-4a40-8c78-87881c15d301 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: c7d28599-67a9-4e84-a44d-79f1a6bf728f] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:58.865611 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell0:SELECT=14 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:26:58.872005 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-17c3fa65-0bdb-4a40-8c78-87881c15d301 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:58.872450 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-17c3fa65-0bdb-4a40-8c78-87881c15d301 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:58.873265 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-17c3fa65-0bdb-4a40-8c78-87881c15d301 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:58.873843 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-17c3fa65-0bdb-4a40-8c78-87881c15d301 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:59.043002 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-17c3fa65-0bdb-4a40-8c78-87881c15d301 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:59.051328 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-17c3fa65-0bdb-4a40-8c78-87881c15d301 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f" status: 200 len: 1365 microversion: 2.1 time: 0.192836 Jul 29 05:26:59.052264 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 404/769] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:58 2022] GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:26:59.309698 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-0d66bc8b-e934-4aca-a0d3-2451aaf71240 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:59.311554 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-0d66bc8b-e934-4aca-a0d3-2451aaf71240 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:59.324593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0d66bc8b-e934-4aca-a0d3-2451aaf71240 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:59.325655 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0d66bc8b-e934-4aca-a0d3-2451aaf71240 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:59.329241 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0d66bc8b-e934-4aca-a0d3-2451aaf71240 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:59.329713 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0d66bc8b-e934-4aca-a0d3-2451aaf71240 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:59.561548 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-0d66bc8b-e934-4aca-a0d3-2451aaf71240 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:59.574250 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-0d66bc8b-e934-4aca-a0d3-2451aaf71240 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1523 microversion: 2.1 time: 0.274042 Jul 29 05:26:59.575287 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 366/770] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:59 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1523 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:26:59.623523 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-1b52b88e-73f2-4043-8a0d-9728af5be776 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:59.628718 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-1b52b88e-73f2-4043-8a0d-9728af5be776 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:59.638820 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1b52b88e-73f2-4043-8a0d-9728af5be776 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:59.639383 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1b52b88e-73f2-4043-8a0d-9728af5be776 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:59.640432 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1b52b88e-73f2-4043-8a0d-9728af5be776 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:59.640927 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1b52b88e-73f2-4043-8a0d-9728af5be776 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:59.792275 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-5626d37e-89ac-4b0f-85db-226d00ac919b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:26:59.792874 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-5626d37e-89ac-4b0f-85db-226d00ac919b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:26:59.800789 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5626d37e-89ac-4b0f-85db-226d00ac919b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:59.801398 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5626d37e-89ac-4b0f-85db-226d00ac919b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:59.802297 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5626d37e-89ac-4b0f-85db-226d00ac919b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:26:59.802843 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5626d37e-89ac-4b0f-85db-226d00ac919b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:26:59.830189 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-5626d37e-89ac-4b0f-85db-226d00ac919b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792/ips" status: 200 len: 151 microversion: 2.20 time: 0.226857 Jul 29 05:26:59.831463 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 405/771] 10.222.0.49 () {60 vars in 1289 bytes} [Fri Jul 29 05:26:59 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792/ips => generated 151 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 05:26:59.849737 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-1b52b88e-73f2-4043-8a0d-9728af5be776 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:26:59.857402 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-1b52b88e-73f2-4043-8a0d-9728af5be776 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1358 microversion: 2.1 time: 0.241163 Jul 29 05:26:59.857993 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 367/772] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:26:59 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:27:00.077891 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-f2b7f01d-d129-4905-b3c2-eb5f640b9d64 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:00.078947 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-f2b7f01d-d129-4905-b3c2-eb5f640b9d64 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: c7d28599-67a9-4e84-a44d-79f1a6bf728f] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:00.099567 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f2b7f01d-d129-4905-b3c2-eb5f640b9d64 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:00.102762 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f2b7f01d-d129-4905-b3c2-eb5f640b9d64 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:00.103837 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f2b7f01d-d129-4905-b3c2-eb5f640b9d64 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:00.104411 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f2b7f01d-d129-4905-b3c2-eb5f640b9d64 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:00.282198 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-f2b7f01d-d129-4905-b3c2-eb5f640b9d64 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:00.293178 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-f2b7f01d-d129-4905-b3c2-eb5f640b9d64 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f" status: 200 len: 1365 microversion: 2.1 time: 0.222731 Jul 29 05:27:00.312397 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 406/773] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:00 2022] GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f => generated 1365 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:27:00.606549 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-04d7fae9-ec52-4783-9a80-1887b90e576f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:00.610236 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-04d7fae9-ec52-4783-9a80-1887b90e576f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:00.639165 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-04d7fae9-ec52-4783-9a80-1887b90e576f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:00.642442 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-04d7fae9-ec52-4783-9a80-1887b90e576f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:00.644763 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-04d7fae9-ec52-4783-9a80-1887b90e576f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:00.645371 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-04d7fae9-ec52-4783-9a80-1887b90e576f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:00.649521 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell1:SELECT=100 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:27:00.864579 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-04d7fae9-ec52-4783-9a80-1887b90e576f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:00.885860 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-0346fd47-e3f8-49e4-9c09-c3037255001c tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:00.886949 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-0346fd47-e3f8-49e4-9c09-c3037255001c tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:00.894807 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-04d7fae9-ec52-4783-9a80-1887b90e576f tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1523 microversion: 2.1 time: 0.298284 Jul 29 05:27:00.911100 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 368/774] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:00 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1523 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:27:00.917361 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0346fd47-e3f8-49e4-9c09-c3037255001c tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:00.918280 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0346fd47-e3f8-49e4-9c09-c3037255001c tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:00.920054 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0346fd47-e3f8-49e4-9c09-c3037255001c tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:00.921400 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0346fd47-e3f8-49e4-9c09-c3037255001c tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:01.113188 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-0346fd47-e3f8-49e4-9c09-c3037255001c tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:01.122722 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-0346fd47-e3f8-49e4-9c09-c3037255001c tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1358 microversion: 2.1 time: 0.241905 Jul 29 05:27:01.131468 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 407/775] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:00 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1358 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:27:01.323293 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-db85f363-aae5-43f0-91ee-37ab3a09f6aa tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:01.323956 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-db85f363-aae5-43f0-91ee-37ab3a09f6aa tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: c7d28599-67a9-4e84-a44d-79f1a6bf728f] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:01.330998 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-db85f363-aae5-43f0-91ee-37ab3a09f6aa tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:01.331523 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-db85f363-aae5-43f0-91ee-37ab3a09f6aa tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:01.332666 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-db85f363-aae5-43f0-91ee-37ab3a09f6aa tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:01.332983 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-db85f363-aae5-43f0-91ee-37ab3a09f6aa tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:01.525116 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-db85f363-aae5-43f0-91ee-37ab3a09f6aa tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:01.539452 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-db85f363-aae5-43f0-91ee-37ab3a09f6aa tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f" status: 200 len: 1365 microversion: 2.1 time: 0.220140 Jul 29 05:27:01.540393 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 369/776] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:01 2022] GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:27:01.930359 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-18a66c43-9986-41c1-ac3b-d79e3fc5aa59 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:01.931043 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-18a66c43-9986-41c1-ac3b-d79e3fc5aa59 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:01.938980 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-18a66c43-9986-41c1-ac3b-d79e3fc5aa59 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:01.939466 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-18a66c43-9986-41c1-ac3b-d79e3fc5aa59 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:01.941459 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-18a66c43-9986-41c1-ac3b-d79e3fc5aa59 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:01.941903 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-18a66c43-9986-41c1-ac3b-d79e3fc5aa59 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:02.131906 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-18a66c43-9986-41c1-ac3b-d79e3fc5aa59 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:02.140550 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-18a66c43-9986-41c1-ac3b-d79e3fc5aa59 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1523 microversion: 2.1 time: 0.214251 Jul 29 05:27:02.141137 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 408/777] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:01 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:27:02.162426 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-670082e1-068a-4af6-a461-3d85ccfc5adf tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:02.164180 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-670082e1-068a-4af6-a461-3d85ccfc5adf tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:02.178367 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-670082e1-068a-4af6-a461-3d85ccfc5adf tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:02.178821 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-670082e1-068a-4af6-a461-3d85ccfc5adf tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:02.179783 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-670082e1-068a-4af6-a461-3d85ccfc5adf tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:02.180229 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-670082e1-068a-4af6-a461-3d85ccfc5adf tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:02.281060 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-9f480ed7-2976-4182-8f04-73ef99a58e40 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:27:02.282591 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-9f480ed7-2976-4182-8f04-73ef99a58e40 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:02.294976 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:27:02.300028 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9f480ed7-2976-4182-8f04-73ef99a58e40 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:02.300948 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9f480ed7-2976-4182-8f04-73ef99a58e40 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:02.302470 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9f480ed7-2976-4182-8f04-73ef99a58e40 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:02.303274 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9f480ed7-2976-4182-8f04-73ef99a58e40 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:02.349606 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.objects.instance [None req-9f480ed7-2976-4182-8f04-73ef99a58e40 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lazy-loading 'flavor' on Instance uuid 1e3305fc-3d92-4d3f-afb8-c25395280792 {{(pid=117821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:27:02.370449 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-670082e1-068a-4af6-a461-3d85ccfc5adf tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:02.380164 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-670082e1-068a-4af6-a461-3d85ccfc5adf tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1358 microversion: 2.1 time: 0.223485 Jul 29 05:27:02.381114 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 370/778] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:02 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:27:02.573117 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-e078775c-8206-48e3-b870-b24a0c46c2c6 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:02.574024 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-e078775c-8206-48e3-b870-b24a0c46c2c6 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: c7d28599-67a9-4e84-a44d-79f1a6bf728f] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:02.583794 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e078775c-8206-48e3-b870-b24a0c46c2c6 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:02.585231 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e078775c-8206-48e3-b870-b24a0c46c2c6 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:02.585231 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e078775c-8206-48e3-b870-b24a0c46c2c6 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:02.585558 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e078775c-8206-48e3-b870-b24a0c46c2c6 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:02.766952 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-e078775c-8206-48e3-b870-b24a0c46c2c6 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:02.775501 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-9f480ed7-2976-4182-8f04-73ef99a58e40 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "POST /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792/action" status: 202 len: 0 microversion: 2.20 time: 0.501421 Jul 29 05:27:02.779418 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 409/779] 10.222.0.49 () {62 vars in 1319 bytes} [Fri Jul 29 05:27:02 2022] POST /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 29 05:27:02.780714 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-e078775c-8206-48e3-b870-b24a0c46c2c6 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f" status: 200 len: 1365 microversion: 2.1 time: 0.213264 Jul 29 05:27:02.781666 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 371/780] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:02 2022] GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:27:02.786605 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-372f953a-92ba-4ce7-b1eb-b2c5f058862e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:02.787301 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-372f953a-92ba-4ce7-b1eb-b2c5f058862e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:02.794612 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-372f953a-92ba-4ce7-b1eb-b2c5f058862e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:02.795069 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-372f953a-92ba-4ce7-b1eb-b2c5f058862e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:02.795880 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-372f953a-92ba-4ce7-b1eb-b2c5f058862e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:02.796321 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-372f953a-92ba-4ce7-b1eb-b2c5f058862e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:02.813138 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:27:02.953840 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-372f953a-92ba-4ce7-b1eb-b2c5f058862e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:02.963809 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-372f953a-92ba-4ce7-b1eb-b2c5f058862e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:02.965365 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-372f953a-92ba-4ce7-b1eb-b2c5f058862e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:02.966542 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-372f953a-92ba-4ce7-b1eb-b2c5f058862e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1722 microversion: 2.20 time: 0.184520 Jul 29 05:27:02.967096 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 410/781] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:02 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:27:03.165057 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-cadb8431-5bb0-4c20-ad72-26dbe1e5352e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:03.165809 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-cadb8431-5bb0-4c20-ad72-26dbe1e5352e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:03.172804 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-cadb8431-5bb0-4c20-ad72-26dbe1e5352e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:03.173415 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-cadb8431-5bb0-4c20-ad72-26dbe1e5352e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:03.174051 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-cadb8431-5bb0-4c20-ad72-26dbe1e5352e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:03.175745 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-cadb8431-5bb0-4c20-ad72-26dbe1e5352e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:03.334759 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-cadb8431-5bb0-4c20-ad72-26dbe1e5352e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:03.343302 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-cadb8431-5bb0-4c20-ad72-26dbe1e5352e tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1523 microversion: 2.1 time: 0.182238 Jul 29 05:27:03.355726 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 372/782] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:03 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:27:03.402482 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-da2af7c4-7fbe-4566-baae-1789b44ed48f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:03.403090 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-da2af7c4-7fbe-4566-baae-1789b44ed48f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:03.411659 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-da2af7c4-7fbe-4566-baae-1789b44ed48f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:03.412106 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-da2af7c4-7fbe-4566-baae-1789b44ed48f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:03.412903 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-da2af7c4-7fbe-4566-baae-1789b44ed48f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:03.413338 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-da2af7c4-7fbe-4566-baae-1789b44ed48f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:03.583475 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-da2af7c4-7fbe-4566-baae-1789b44ed48f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:03.598291 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-da2af7c4-7fbe-4566-baae-1789b44ed48f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1358 microversion: 2.1 time: 0.199564 Jul 29 05:27:03.599417 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 411/783] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:03 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:27:03.802206 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-1e557620-3c9c-4e22-a60d-0ba71d1e99b0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:03.802718 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-1e557620-3c9c-4e22-a60d-0ba71d1e99b0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: c7d28599-67a9-4e84-a44d-79f1a6bf728f] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:03.809362 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1e557620-3c9c-4e22-a60d-0ba71d1e99b0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:03.809810 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1e557620-3c9c-4e22-a60d-0ba71d1e99b0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:03.810591 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1e557620-3c9c-4e22-a60d-0ba71d1e99b0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:03.811034 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1e557620-3c9c-4e22-a60d-0ba71d1e99b0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:03.993234 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-72d8e6e2-3d49-4cd7-8ba2-2899178cb90b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:03.994087 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-72d8e6e2-3d49-4cd7-8ba2-2899178cb90b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:04.009385 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-72d8e6e2-3d49-4cd7-8ba2-2899178cb90b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:04.009840 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-72d8e6e2-3d49-4cd7-8ba2-2899178cb90b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:04.010633 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-72d8e6e2-3d49-4cd7-8ba2-2899178cb90b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:04.011071 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-72d8e6e2-3d49-4cd7-8ba2-2899178cb90b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:04.224461 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-72d8e6e2-3d49-4cd7-8ba2-2899178cb90b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:04.234902 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-72d8e6e2-3d49-4cd7-8ba2-2899178cb90b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:04.236551 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-72d8e6e2-3d49-4cd7-8ba2-2899178cb90b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:04.238102 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-72d8e6e2-3d49-4cd7-8ba2-2899178cb90b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1722 microversion: 2.20 time: 0.251623 Jul 29 05:27:04.238651 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 412/784] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:03 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:27:04.272570 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-1e557620-3c9c-4e22-a60d-0ba71d1e99b0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:04.281016 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-1e557620-3c9c-4e22-a60d-0ba71d1e99b0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f" status: 200 len: 1365 microversion: 2.1 time: 0.482924 Jul 29 05:27:04.281625 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 373/785] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:03 2022] GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f => generated 1365 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:27:04.367980 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-5e59c2a3-6b74-4f8b-a986-0d1f79a63230 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:04.368535 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-5e59c2a3-6b74-4f8b-a986-0d1f79a63230 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:04.375975 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5e59c2a3-6b74-4f8b-a986-0d1f79a63230 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:04.376454 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5e59c2a3-6b74-4f8b-a986-0d1f79a63230 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:04.377387 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5e59c2a3-6b74-4f8b-a986-0d1f79a63230 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:04.378011 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5e59c2a3-6b74-4f8b-a986-0d1f79a63230 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:04.542684 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-5e59c2a3-6b74-4f8b-a986-0d1f79a63230 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:04.555147 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-5e59c2a3-6b74-4f8b-a986-0d1f79a63230 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1523 microversion: 2.1 time: 0.191088 Jul 29 05:27:04.555760 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 413/786] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:04 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:27:04.635449 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-585fdcd1-6a05-484a-944a-68dadbc85451 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:04.635975 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-585fdcd1-6a05-484a-944a-68dadbc85451 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:04.642631 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-585fdcd1-6a05-484a-944a-68dadbc85451 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:04.644489 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-585fdcd1-6a05-484a-944a-68dadbc85451 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:04.645345 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-585fdcd1-6a05-484a-944a-68dadbc85451 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:04.645795 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-585fdcd1-6a05-484a-944a-68dadbc85451 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:04.927439 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-585fdcd1-6a05-484a-944a-68dadbc85451 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:04.935394 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-585fdcd1-6a05-484a-944a-68dadbc85451 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1358 microversion: 2.1 time: 0.303940 Jul 29 05:27:04.935990 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 374/787] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:04 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1358 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:27:05.025233 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-16371a8f-55d4-46f2-9374-91a3ee14ca93 req-673216e4-1d23-46b5-a649-d249abc57da7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f080dde-4e70-4d3f-aa8c-ced0a1065d3d", "name": "network-vif-deleted", "tag": "add97173-f389-4e35-b131-c4e58524e3c9"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:27:05.037589 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-16371a8f-55d4-46f2-9374-91a3ee14ca93 req-673216e4-1d23-46b5-a649-d249abc57da7 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:05.038030 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-16371a8f-55d4-46f2-9374-91a3ee14ca93 req-673216e4-1d23-46b5-a649-d249abc57da7 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:05.050024 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-16371a8f-55d4-46f2-9374-91a3ee14ca93 req-673216e4-1d23-46b5-a649-d249abc57da7 service nova] Creating event network-vif-deleted:add97173-f389-4e35-b131-c4e58524e3c9 for instance 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d on hv-cinder-85127 Jul 29 05:27:05.055276 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-16371a8f-55d4-46f2-9374-91a3ee14ca93 req-673216e4-1d23-46b5-a649-d249abc57da7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034077 Jul 29 05:27:05.056175 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 414/788] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:27:05.262879 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-e37fcf63-11bd-4fcc-9142-d3ff2c7b3342 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:05.263717 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-e37fcf63-11bd-4fcc-9142-d3ff2c7b3342 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:05.272430 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e37fcf63-11bd-4fcc-9142-d3ff2c7b3342 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:05.272974 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e37fcf63-11bd-4fcc-9142-d3ff2c7b3342 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:05.273815 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e37fcf63-11bd-4fcc-9142-d3ff2c7b3342 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:05.274326 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e37fcf63-11bd-4fcc-9142-d3ff2c7b3342 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:05.307733 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-1b284ba8-e4c2-443d-961c-a92b02d8b535 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:05.309053 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-1b284ba8-e4c2-443d-961c-a92b02d8b535 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: c7d28599-67a9-4e84-a44d-79f1a6bf728f] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:05.321960 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1b284ba8-e4c2-443d-961c-a92b02d8b535 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:05.322784 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1b284ba8-e4c2-443d-961c-a92b02d8b535 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:05.324226 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1b284ba8-e4c2-443d-961c-a92b02d8b535 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:05.325352 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1b284ba8-e4c2-443d-961c-a92b02d8b535 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:05.458966 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-e37fcf63-11bd-4fcc-9142-d3ff2c7b3342 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:05.468449 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-e37fcf63-11bd-4fcc-9142-d3ff2c7b3342 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:05.470014 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-e37fcf63-11bd-4fcc-9142-d3ff2c7b3342 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:05.472465 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-e37fcf63-11bd-4fcc-9142-d3ff2c7b3342 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1722 microversion: 2.20 time: 0.213442 Jul 29 05:27:05.472655 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 375/789] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:05 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:27:05.571183 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-1b284ba8-e4c2-443d-961c-a92b02d8b535 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:05.580169 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-1b284ba8-e4c2-443d-961c-a92b02d8b535 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f" status: 200 len: 1365 microversion: 2.1 time: 0.281198 Jul 29 05:27:05.581318 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 415/790] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:05 2022] GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f => generated 1365 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:27:05.581504 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-52e2ac0d-086e-43ca-91d9-a49099ba9ddb tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:05.582316 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-52e2ac0d-086e-43ca-91d9-a49099ba9ddb tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:05.590195 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-52e2ac0d-086e-43ca-91d9-a49099ba9ddb tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:05.590857 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-52e2ac0d-086e-43ca-91d9-a49099ba9ddb tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:05.591880 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-52e2ac0d-086e-43ca-91d9-a49099ba9ddb tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:05.592462 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-52e2ac0d-086e-43ca-91d9-a49099ba9ddb tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:05.667823 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-52e2ac0d-086e-43ca-91d9-a49099ba9ddb tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae88234e984149be8539757efa8733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153fe5d9d64346f6b7419eba91948678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:05.679881 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-52e2ac0d-086e-43ca-91d9-a49099ba9ddb tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 200 len: 1481 microversion: 2.1 time: 0.104161 Jul 29 05:27:05.681691 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 376/791] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:05 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 1481 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:27:05.957642 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-65905fd7-eeec-49b3-87fa-2b4b679c498f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:05.958263 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-65905fd7-eeec-49b3-87fa-2b4b679c498f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:05.964994 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-65905fd7-eeec-49b3-87fa-2b4b679c498f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:05.965450 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-65905fd7-eeec-49b3-87fa-2b4b679c498f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:05.966236 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-65905fd7-eeec-49b3-87fa-2b4b679c498f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:05.966677 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-65905fd7-eeec-49b3-87fa-2b4b679c498f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:06.107573 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-65905fd7-eeec-49b3-87fa-2b4b679c498f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:06.115561 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-65905fd7-eeec-49b3-87fa-2b4b679c498f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1358 microversion: 2.1 time: 0.162030 Jul 29 05:27:06.116165 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 416/792] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:05 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:27:06.495992 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-9d714046-a1ed-4061-8268-5b22e6bdbffa tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:06.496645 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-9d714046-a1ed-4061-8268-5b22e6bdbffa tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:06.506309 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9d714046-a1ed-4061-8268-5b22e6bdbffa tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:06.507160 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9d714046-a1ed-4061-8268-5b22e6bdbffa tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:06.508991 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9d714046-a1ed-4061-8268-5b22e6bdbffa tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:06.510747 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9d714046-a1ed-4061-8268-5b22e6bdbffa tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:06.620694 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-f99ded67-1a7f-45e8-bc13-4a247e0cde75 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:06.621869 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-f99ded67-1a7f-45e8-bc13-4a247e0cde75 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: c7d28599-67a9-4e84-a44d-79f1a6bf728f] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:06.647972 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f99ded67-1a7f-45e8-bc13-4a247e0cde75 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:06.648924 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f99ded67-1a7f-45e8-bc13-4a247e0cde75 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:06.650472 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f99ded67-1a7f-45e8-bc13-4a247e0cde75 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:06.651148 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f99ded67-1a7f-45e8-bc13-4a247e0cde75 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:06.739687 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-9d714046-a1ed-4061-8268-5b22e6bdbffa tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:06.749604 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-9d714046-a1ed-4061-8268-5b22e6bdbffa tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:06.752656 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-9d714046-a1ed-4061-8268-5b22e6bdbffa tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:06.754768 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-9d714046-a1ed-4061-8268-5b22e6bdbffa tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1722 microversion: 2.20 time: 0.261973 Jul 29 05:27:06.755398 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 377/793] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:06 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:27:06.760547 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-f1341360-83c9-47ef-a736-609ee69b6765 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:06.762408 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-f1341360-83c9-47ef-a736-609ee69b6765 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] [instance: 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:06.773078 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f1341360-83c9-47ef-a736-609ee69b6765 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:06.773903 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f1341360-83c9-47ef-a736-609ee69b6765 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:06.774695 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f1341360-83c9-47ef-a736-609ee69b6765 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:06.775138 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f1341360-83c9-47ef-a736-609ee69b6765 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:06.792025 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.wsgi [None req-f1341360-83c9-47ef-a736-609ee69b6765 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] HTTP exception thrown: Instance 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d could not be found. Jul 29 05:27:06.793580 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-f1341360-83c9-47ef-a736-609ee69b6765 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Request method failure captured: Jul 29 05:27:06.793580 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: request: GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d HTTP/1.1 Jul 29 05:27:06.793580 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept: application/json Jul 29 05:27:06.793580 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept-Encoding: identity Jul 29 05:27:06.793580 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Connection: close Jul 29 05:27:06.793580 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Length: 0 Jul 29 05:27:06.793580 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Type: application/json Jul 29 05:27:06.793580 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Host: 10.222.0.49 Jul 29 05:27:06.793580 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Openstack-System-Scope: None Jul 29 05:27:06.793580 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: User-Agent: python-urllib3/1.26.10 Jul 29 05:27:06.793580 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Auth-Token: gAAAAABi425NDze3MZ6r1VD0FCYdq0OmQOLp-a8UlwTMNu4OjL5RkBuPvg1CcwPwgOttOt-6wL5UPCvTmDT4dvtmSR2MiB9UhU4F3cFaVbG964PhwtxReJ17pRKIo-RqoKvGgdruft6DgwjaYgOO11XCIKmUEetc8GovjBVxuznVeh-B9PpnvOw Jul 29 05:27:06.793580 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Id: None Jul 29 05:27:06.793580 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Name: None Jul 29 05:27:06.793580 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Identity-Status: Confirmed Jul 29 05:27:06.793580 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Is-Admin-Project: True Jul 29 05:27:06.793580 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Id: default Jul 29 05:27:06.793580 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Name: Default Jul 29 05:27:06.793580 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Id: 153fe5d9d64346f6b7419eba91948678 Jul 29 05:27:06.793580 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1077257590 Jul 29 05:27:06.793580 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Role: member,reader Jul 29 05:27:06.793580 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Roles: member,reader Jul 29 05:27:06.796686 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/153fe5d9d64346f6b7419eba91948678"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/153fe5d9d64346f6b7419eba91948678"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_153fe5d9d64346f6b7419eba91948678"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/153fe5d9d64346f6b7419eba91948678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:27:06.796686 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1077257590 Jul 29 05:27:06.796686 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Id: 153fe5d9d64346f6b7419eba91948678 Jul 29 05:27:06.796686 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1077257590 Jul 29 05:27:06.796686 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User: tempest-ServerRescueNegativeTestJSON-1077257590-project Jul 29 05:27:06.796686 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Id: default Jul 29 05:27:06.796686 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Name: Default Jul 29 05:27:06.796686 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Id: 45ae88234e984149be8539757efa8733 Jul 29 05:27:06.796686 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1077257590-project Jul 29 05:27:06.796686 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: method: > Jul 29 05:27:06.796686 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: exception: Instance 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d could not be found. Jul 29 05:27:06.796686 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: action_args: {'id': '3f080dde-4e70-4d3f-aa8c-ced0a1065d3d'} Jul 29 05:27:06.798240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:27:06.798240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:06.798240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:27:06.798240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:27:06.798240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:27:06.798240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:27:06.798240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:27:06.798240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:27:06.798240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:27:06.798240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:27:06.798240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d could not be found. Jul 29 05:27:06.798240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:27:06.798240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:27:06.798240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:27:06.798240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:06.798240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:27:06.798240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:27:06.798240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:27:06.798240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:27:06.798240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:27:06.803792 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:27:06.803792 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:27:06.803792 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:27:06.803792 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:27:06.803792 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:27:06.803792 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:27:06.803792 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:27:06.803792 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d could not be found. Jul 29 05:27:06.803792 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:27:06.803792 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:27:06.803792 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:27:06.803792 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:06.803792 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:27:06.803792 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:27:06.803792 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:27:06.803792 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:27:06.803792 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d could not be found. Jul 29 05:27:06.803792 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:27:06.809778 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-f1341360-83c9-47ef-a736-609ee69b6765 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] Returning 404 to user: Instance 3f080dde-4e70-4d3f-aa8c-ced0a1065d3d could not be found. {{(pid=117820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:27:06.809778 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-f1341360-83c9-47ef-a736-609ee69b6765 tempest-ServerRescueNegativeTestJSON-1077257590 tempest-ServerRescueNegativeTestJSON-1077257590-project] 10.222.0.49 "GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d" status: 404 len: 111 microversion: 2.1 time: 0.038432 Jul 29 05:27:06.809778 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 378/794] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:06 2022] GET /compute/v2.1/servers/3f080dde-4e70-4d3f-aa8c-ced0a1065d3d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:27:06.861130 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-f99ded67-1a7f-45e8-bc13-4a247e0cde75 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:06.875933 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-f99ded67-1a7f-45e8-bc13-4a247e0cde75 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f" status: 200 len: 1365 microversion: 2.1 time: 0.275334 Jul 29 05:27:06.878458 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 417/795] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:06 2022] GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f => generated 1365 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:27:07.141994 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-0e98ebfc-2f1e-40a5-ae71-71e05fd778a7 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:07.145097 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-0e98ebfc-2f1e-40a5-ae71-71e05fd778a7 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:07.156462 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0e98ebfc-2f1e-40a5-ae71-71e05fd778a7 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:07.157166 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0e98ebfc-2f1e-40a5-ae71-71e05fd778a7 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:07.159923 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0e98ebfc-2f1e-40a5-ae71-71e05fd778a7 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:07.160594 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0e98ebfc-2f1e-40a5-ae71-71e05fd778a7 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:07.788933 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-6f63c94e-1d87-43ea-b1c1-4714faf41131 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:07.789955 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-6f63c94e-1d87-43ea-b1c1-4714faf41131 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:07.802555 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6f63c94e-1d87-43ea-b1c1-4714faf41131 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:07.803324 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6f63c94e-1d87-43ea-b1c1-4714faf41131 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:07.804825 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6f63c94e-1d87-43ea-b1c1-4714faf41131 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:07.805600 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6f63c94e-1d87-43ea-b1c1-4714faf41131 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:07.887546 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-0e98ebfc-2f1e-40a5-ae71-71e05fd778a7 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:07.899728 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-0e98ebfc-2f1e-40a5-ae71-71e05fd778a7 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1358 microversion: 2.1 time: 0.764662 Jul 29 05:27:07.915976 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 379/796] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:07 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1358 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:27:07.924608 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-2910cbb9-da66-4fda-859a-d0af5edbb6ac tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:07.925872 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-2910cbb9-da66-4fda-859a-d0af5edbb6ac tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: c7d28599-67a9-4e84-a44d-79f1a6bf728f] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:07.934885 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2910cbb9-da66-4fda-859a-d0af5edbb6ac tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:07.935516 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2910cbb9-da66-4fda-859a-d0af5edbb6ac tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:07.936370 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2910cbb9-da66-4fda-859a-d0af5edbb6ac tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:07.936958 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2910cbb9-da66-4fda-859a-d0af5edbb6ac tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:08.033934 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-6f63c94e-1d87-43ea-b1c1-4714faf41131 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:08.043071 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-6f63c94e-1d87-43ea-b1c1-4714faf41131 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:08.044769 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-6f63c94e-1d87-43ea-b1c1-4714faf41131 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:08.046030 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-6f63c94e-1d87-43ea-b1c1-4714faf41131 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1722 microversion: 2.20 time: 0.265382 Jul 29 05:27:08.046616 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 418/797] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:07 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:27:08.267404 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-2910cbb9-da66-4fda-859a-d0af5edbb6ac tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:08.280720 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-2910cbb9-da66-4fda-859a-d0af5edbb6ac tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f" status: 200 len: 1365 microversion: 2.1 time: 0.363292 Jul 29 05:27:08.282042 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 380/798] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:07 2022] GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f => generated 1365 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:27:08.933455 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-aa85fd16-b799-46b4-bb8b-94b370c286cc tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:08.934050 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-aa85fd16-b799-46b4-bb8b-94b370c286cc tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:08.940433 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:27:08.962021 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-aa85fd16-b799-46b4-bb8b-94b370c286cc tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:08.962899 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-aa85fd16-b799-46b4-bb8b-94b370c286cc tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:08.969461 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-aa85fd16-b799-46b4-bb8b-94b370c286cc tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:08.970024 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-aa85fd16-b799-46b4-bb8b-94b370c286cc tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:09.016190 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-71a73b39-7579-4fc2-9d71-bdee574d86ae req-ad3b201c-3e5e-41a3-b023-83bcd1ae9968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8e59cc2-032c-497f-867c-2d5663a4da21", "name": "network-vif-plugged", "status": "completed", "tag": "6d8585cd-d0d9-4ae4-9146-299c453184a4"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:27:09.043881 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-71a73b39-7579-4fc2-9d71-bdee574d86ae req-ad3b201c-3e5e-41a3-b023-83bcd1ae9968 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:09.044893 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-71a73b39-7579-4fc2-9d71-bdee574d86ae req-ad3b201c-3e5e-41a3-b023-83bcd1ae9968 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:09.068787 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-71a73b39-7579-4fc2-9d71-bdee574d86ae req-ad3b201c-3e5e-41a3-b023-83bcd1ae9968 service nova] Creating event network-vif-plugged:6d8585cd-d0d9-4ae4-9146-299c453184a4 for instance a8e59cc2-032c-497f-867c-2d5663a4da21 on hv-cinder-85127 Jul 29 05:27:09.074034 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-71a73b39-7579-4fc2-9d71-bdee574d86ae req-ad3b201c-3e5e-41a3-b023-83bcd1ae9968 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207468 Jul 29 05:27:09.075103 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 419/799] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:27:09.082156 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-528f448c-230c-4966-b461-9a4a814385aa tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:09.083966 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-528f448c-230c-4966-b461-9a4a814385aa tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:09.092438 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-528f448c-230c-4966-b461-9a4a814385aa tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:09.093369 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-528f448c-230c-4966-b461-9a4a814385aa tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:09.094449 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-528f448c-230c-4966-b461-9a4a814385aa tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:09.095101 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-528f448c-230c-4966-b461-9a4a814385aa tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:09.299134 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-528f448c-230c-4966-b461-9a4a814385aa tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:09.316049 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-528f448c-230c-4966-b461-9a4a814385aa tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:09.318361 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-528f448c-230c-4966-b461-9a4a814385aa tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:09.319634 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-528f448c-230c-4966-b461-9a4a814385aa tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1722 microversion: 2.20 time: 0.243085 Jul 29 05:27:09.320198 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 420/800] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:09 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:27:09.325350 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-5d350dd1-2a21-4b6e-b83b-cd3a2a001f2c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:09.326377 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-5d350dd1-2a21-4b6e-b83b-cd3a2a001f2c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: c7d28599-67a9-4e84-a44d-79f1a6bf728f] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:09.334561 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5d350dd1-2a21-4b6e-b83b-cd3a2a001f2c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:09.335308 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5d350dd1-2a21-4b6e-b83b-cd3a2a001f2c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:09.336486 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5d350dd1-2a21-4b6e-b83b-cd3a2a001f2c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:09.337092 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5d350dd1-2a21-4b6e-b83b-cd3a2a001f2c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:09.429546 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-aa85fd16-b799-46b4-bb8b-94b370c286cc tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:09.449321 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-aa85fd16-b799-46b4-bb8b-94b370c286cc tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1358 microversion: 2.1 time: 0.522077 Jul 29 05:27:09.471516 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 381/801] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:08 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1358 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:27:09.590547 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-5d350dd1-2a21-4b6e-b83b-cd3a2a001f2c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:09.606265 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-5d350dd1-2a21-4b6e-b83b-cd3a2a001f2c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f" status: 200 len: 1365 microversion: 2.1 time: 0.284035 Jul 29 05:27:09.614363 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 421/802] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:09 2022] GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f => generated 1365 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:27:10.358253 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-ec653beb-d826-4521-8601-06a4fb16d4e2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:10.358868 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-ec653beb-d826-4521-8601-06a4fb16d4e2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:10.366045 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ec653beb-d826-4521-8601-06a4fb16d4e2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:10.366602 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ec653beb-d826-4521-8601-06a4fb16d4e2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:10.367434 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ec653beb-d826-4521-8601-06a4fb16d4e2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:10.367885 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ec653beb-d826-4521-8601-06a4fb16d4e2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:10.489464 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-ce1f4bd2-8caa-40f4-84f4-cb347c05f425 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:10.490831 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-ce1f4bd2-8caa-40f4-84f4-cb347c05f425 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:10.503494 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ce1f4bd2-8caa-40f4-84f4-cb347c05f425 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:10.504340 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ce1f4bd2-8caa-40f4-84f4-cb347c05f425 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:10.505437 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ce1f4bd2-8caa-40f4-84f4-cb347c05f425 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:10.506064 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ce1f4bd2-8caa-40f4-84f4-cb347c05f425 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:10.682058 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-ce1f4bd2-8caa-40f4-84f4-cb347c05f425 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:10.692252 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-ce1f4bd2-8caa-40f4-84f4-cb347c05f425 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1358 microversion: 2.1 time: 0.211269 Jul 29 05:27:10.693251 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 422/803] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:10 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:27:10.720933 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-9dba2b52-0bb2-4f6b-a3c6-d4a037e69c4c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:10.721562 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-9dba2b52-0bb2-4f6b-a3c6-d4a037e69c4c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: c7d28599-67a9-4e84-a44d-79f1a6bf728f] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:10.741643 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9dba2b52-0bb2-4f6b-a3c6-d4a037e69c4c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:10.742650 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9dba2b52-0bb2-4f6b-a3c6-d4a037e69c4c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:10.744594 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9dba2b52-0bb2-4f6b-a3c6-d4a037e69c4c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:10.745695 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9dba2b52-0bb2-4f6b-a3c6-d4a037e69c4c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:10.755425 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-ec653beb-d826-4521-8601-06a4fb16d4e2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:10.776547 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-ec653beb-d826-4521-8601-06a4fb16d4e2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:10.778651 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-ec653beb-d826-4521-8601-06a4fb16d4e2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:10.780518 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-ec653beb-d826-4521-8601-06a4fb16d4e2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1722 microversion: 2.20 time: 0.426225 Jul 29 05:27:10.781758 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 382/804] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:10 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1722 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:27:11.022243 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-9dba2b52-0bb2-4f6b-a3c6-d4a037e69c4c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:11.030548 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-9dba2b52-0bb2-4f6b-a3c6-d4a037e69c4c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f" status: 200 len: 1365 microversion: 2.1 time: 0.313902 Jul 29 05:27:11.031821 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 423/805] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:10 2022] GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f => generated 1365 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:27:11.092333 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-1d29e8d5-7dee-4870-ab13-b1a183861bb5 req-1076cec4-c0f6-45c6-b62c-5c251b79ec16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7d28599-67a9-4e84-a44d-79f1a6bf728f", "name": "network-vif-plugged", "status": "completed", "tag": "c7e12f70-c8c8-48ec-9fd7-5a69b095e812"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:27:11.104611 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-1d29e8d5-7dee-4870-ab13-b1a183861bb5 req-1076cec4-c0f6-45c6-b62c-5c251b79ec16 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:11.105170 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-1d29e8d5-7dee-4870-ab13-b1a183861bb5 req-1076cec4-c0f6-45c6-b62c-5c251b79ec16 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:11.125305 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-1d29e8d5-7dee-4870-ab13-b1a183861bb5 req-1076cec4-c0f6-45c6-b62c-5c251b79ec16 service nova] Creating event network-vif-plugged:c7e12f70-c8c8-48ec-9fd7-5a69b095e812 for instance c7d28599-67a9-4e84-a44d-79f1a6bf728f on hv-cinder-85127 Jul 29 05:27:11.133479 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-1d29e8d5-7dee-4870-ab13-b1a183861bb5 req-1076cec4-c0f6-45c6-b62c-5c251b79ec16 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045735 Jul 29 05:27:11.134487 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 383/806] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:27:11.716973 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-4252f5e8-0c58-4088-b145-f078ceafe58d tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:11.718076 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-4252f5e8-0c58-4088-b145-f078ceafe58d tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:11.730854 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4252f5e8-0c58-4088-b145-f078ceafe58d tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:11.732129 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4252f5e8-0c58-4088-b145-f078ceafe58d tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:11.733453 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4252f5e8-0c58-4088-b145-f078ceafe58d tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:11.734483 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4252f5e8-0c58-4088-b145-f078ceafe58d tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:11.820820 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-398eebf2-a2ac-4f39-be1c-55b319f948af tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:11.821526 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-398eebf2-a2ac-4f39-be1c-55b319f948af tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:11.829157 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-398eebf2-a2ac-4f39-be1c-55b319f948af tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:11.831317 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-398eebf2-a2ac-4f39-be1c-55b319f948af tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:11.831604 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-398eebf2-a2ac-4f39-be1c-55b319f948af tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:11.831912 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-398eebf2-a2ac-4f39-be1c-55b319f948af tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:12.009045 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-4252f5e8-0c58-4088-b145-f078ceafe58d tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:12.018796 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-4252f5e8-0c58-4088-b145-f078ceafe58d tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1548 microversion: 2.1 time: 0.308030 Jul 29 05:27:12.019718 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 424/807] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:11 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1548 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:27:12.032010 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-398eebf2-a2ac-4f39-be1c-55b319f948af tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:12.045937 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-818c3dfd-33c5-441c-ac0a-b5202181bda6 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:12.046556 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-818c3dfd-33c5-441c-ac0a-b5202181bda6 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:12.050950 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-398eebf2-a2ac-4f39-be1c-55b319f948af tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:12.054479 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-398eebf2-a2ac-4f39-be1c-55b319f948af tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:12.056094 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-818c3dfd-33c5-441c-ac0a-b5202181bda6 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:12.057408 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-818c3dfd-33c5-441c-ac0a-b5202181bda6 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:12.057559 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-398eebf2-a2ac-4f39-be1c-55b319f948af tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1722 microversion: 2.20 time: 0.243294 Jul 29 05:27:12.058546 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-818c3dfd-33c5-441c-ac0a-b5202181bda6 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:12.059208 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-818c3dfd-33c5-441c-ac0a-b5202181bda6 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:12.067988 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 384/808] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:11 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1722 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:27:12.081101 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-a80ee2fe-388a-450c-8ff0-60b981a4aa5c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:12.082744 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-a80ee2fe-388a-450c-8ff0-60b981a4aa5c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: c7d28599-67a9-4e84-a44d-79f1a6bf728f] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:12.090541 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a80ee2fe-388a-450c-8ff0-60b981a4aa5c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:12.091588 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a80ee2fe-388a-450c-8ff0-60b981a4aa5c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:12.092699 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a80ee2fe-388a-450c-8ff0-60b981a4aa5c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:12.093435 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a80ee2fe-388a-450c-8ff0-60b981a4aa5c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:12.223023 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-818c3dfd-33c5-441c-ac0a-b5202181bda6 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:12.231990 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-818c3dfd-33c5-441c-ac0a-b5202181bda6 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1548 microversion: 2.1 time: 0.189842 Jul 29 05:27:12.243829 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 425/809] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:12 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1548 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:27:12.252885 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-7204e6b2-acb1-49f8-88f1-3bb2d63a2a58 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:12.258344 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-7204e6b2-acb1-49f8-88f1-3bb2d63a2a58 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:12.259493 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-7204e6b2-acb1-49f8-88f1-3bb2d63a2a58 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Searching by: {'deleted': False, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf'} {{(pid=117821) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 29 05:27:12.266521 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7204e6b2-acb1-49f8-88f1-3bb2d63a2a58 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:12.266968 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7204e6b2-acb1-49f8-88f1-3bb2d63a2a58 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:12.267880 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7204e6b2-acb1-49f8-88f1-3bb2d63a2a58 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:12.268321 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7204e6b2-acb1-49f8-88f1-3bb2d63a2a58 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:12.290451 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-a80ee2fe-388a-450c-8ff0-60b981a4aa5c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:12.302392 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-a80ee2fe-388a-450c-8ff0-60b981a4aa5c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f" status: 200 len: 1365 microversion: 2.1 time: 0.232829 Jul 29 05:27:12.302986 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 385/810] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:12 2022] GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f => generated 1365 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:27:12.378695 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.multi_cell_list [None req-7204e6b2-acb1-49f8-88f1-3bb2d63a2a58 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117821) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 29 05:27:12.520690 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-7204e6b2-acb1-49f8-88f1-3bb2d63a2a58 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.271495 Jul 29 05:27:12.521230 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 426/811] 10.222.0.49 () {58 vars in 1125 bytes} [Fri Jul 29 05:27:12 2022] GET /compute/v2.1/servers => generated 342 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:27:12.533587 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-33cea29d-0be4-41a5-8cef-ab27bf988e41 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:12.534632 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-33cea29d-0be4-41a5-8cef-ab27bf988e41 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:12.541983 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-33cea29d-0be4-41a5-8cef-ab27bf988e41 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:12.542433 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-33cea29d-0be4-41a5-8cef-ab27bf988e41 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:12.543216 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-33cea29d-0be4-41a5-8cef-ab27bf988e41 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:12.543707 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-33cea29d-0be4-41a5-8cef-ab27bf988e41 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:12.546844 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell1:SELECT=100 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:27:12.766078 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-33cea29d-0be4-41a5-8cef-ab27bf988e41 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:12.775135 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-33cea29d-0be4-41a5-8cef-ab27bf988e41 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1548 microversion: 2.1 time: 0.245569 Jul 29 05:27:12.775759 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 386/812] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:12 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1548 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:27:13.093582 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-18dd1f4c-cd7f-462e-81ae-92c773eaff53 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:13.095903 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-18dd1f4c-cd7f-462e-81ae-92c773eaff53 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:13.107283 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-18dd1f4c-cd7f-462e-81ae-92c773eaff53 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:13.112315 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-18dd1f4c-cd7f-462e-81ae-92c773eaff53 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:13.113191 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-18dd1f4c-cd7f-462e-81ae-92c773eaff53 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:13.117244 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-18dd1f4c-cd7f-462e-81ae-92c773eaff53 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:13.337874 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-e993c55b-ba9e-4c55-915e-554d9092e908 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:13.339395 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-e993c55b-ba9e-4c55-915e-554d9092e908 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: c7d28599-67a9-4e84-a44d-79f1a6bf728f] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:13.347629 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e993c55b-ba9e-4c55-915e-554d9092e908 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:13.348099 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e993c55b-ba9e-4c55-915e-554d9092e908 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:13.348901 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e993c55b-ba9e-4c55-915e-554d9092e908 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:13.349349 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e993c55b-ba9e-4c55-915e-554d9092e908 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:13.402808 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-18dd1f4c-cd7f-462e-81ae-92c773eaff53 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:13.418143 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-18dd1f4c-cd7f-462e-81ae-92c773eaff53 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:13.420259 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-18dd1f4c-cd7f-462e-81ae-92c773eaff53 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:13.421876 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-18dd1f4c-cd7f-462e-81ae-92c773eaff53 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1722 microversion: 2.20 time: 0.332650 Jul 29 05:27:13.422886 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 427/813] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:13 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1722 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:27:13.556873 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-e993c55b-ba9e-4c55-915e-554d9092e908 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:13.566763 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-e993c55b-ba9e-4c55-915e-554d9092e908 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f" status: 200 len: 1554 microversion: 2.1 time: 0.232857 Jul 29 05:27:13.567698 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 387/814] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:13 2022] GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f => generated 1554 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:27:13.593912 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-1f34d442-7ee9-47d3-bd66-8146fe7ff9b8 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:13.594805 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-1f34d442-7ee9-47d3-bd66-8146fe7ff9b8 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: c7d28599-67a9-4e84-a44d-79f1a6bf728f] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:13.608247 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1f34d442-7ee9-47d3-bd66-8146fe7ff9b8 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:13.608970 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1f34d442-7ee9-47d3-bd66-8146fe7ff9b8 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:13.610317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1f34d442-7ee9-47d3-bd66-8146fe7ff9b8 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:13.611080 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1f34d442-7ee9-47d3-bd66-8146fe7ff9b8 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:13.619640 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell1:SELECT=100 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:27:13.744359 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-1f34d442-7ee9-47d3-bd66-8146fe7ff9b8 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.157389 Jul 29 05:27:13.745500 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 428/815] 10.222.0.49 () {58 vars in 1275 bytes} [Fri Jul 29 05:27:13 2022] GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f/os-interface => generated 284 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:27:13.969074 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-12f76a07-0734-474f-a369-b9fb941b8726 tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] Action: 'create', calling method: .version_select at 0x7fa63aba1d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-273125210"}} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:27:14.464034 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-118fe76d-ee32-4e7c-962c-29f0be9474df tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:14.464958 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-118fe76d-ee32-4e7c-962c-29f0be9474df tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:14.480648 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-118fe76d-ee32-4e7c-962c-29f0be9474df tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:14.482893 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-118fe76d-ee32-4e7c-962c-29f0be9474df tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:14.483971 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-118fe76d-ee32-4e7c-962c-29f0be9474df tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:14.485489 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-118fe76d-ee32-4e7c-962c-29f0be9474df tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:14.526913 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-12f76a07-0734-474f-a369-b9fb941b8726 tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.740083 Jul 29 05:27:14.528493 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 388/816] 10.222.0.49 () {60 vars in 1155 bytes} [Fri Jul 29 05:27:13 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 742 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 29 05:27:14.553353 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-afacbb56-ae82-4b39-be88-8e9e1c6bcad0 tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] Calling method '.version_select at 0x7fa63ad7b040>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:14.676140 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-afacbb56-ae82-4b39-be88-8e9e1c6bcad0 tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/f0fd3745-1229-4ae5-bd0a-604a37b6b3a6" status: 200 len: 344 microversion: 2.1 time: 0.129337 Jul 29 05:27:14.679433 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 389/817] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Jul 29 05:27:14 2022] GET /compute/v2.1/os-volumes/f0fd3745-1229-4ae5-bd0a-604a37b6b3a6 => generated 344 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:27:14.703188 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-f42fcaab-9064-4be4-8e34-5ccee440e69f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03691a97-df08-4735-93e2-6a80a2183f9d"}} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:27:14.706850 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-f42fcaab-9064-4be4-8e34-5ccee440e69f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:14.715227 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f42fcaab-9064-4be4-8e34-5ccee440e69f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:14.716149 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f42fcaab-9064-4be4-8e34-5ccee440e69f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:14.717227 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f42fcaab-9064-4be4-8e34-5ccee440e69f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:14.718047 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f42fcaab-9064-4be4-8e34-5ccee440e69f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:14.906927 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-118fe76d-ee32-4e7c-962c-29f0be9474df tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:14.926613 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-118fe76d-ee32-4e7c-962c-29f0be9474df tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:14.929889 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-118fe76d-ee32-4e7c-962c-29f0be9474df tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:14.931197 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-118fe76d-ee32-4e7c-962c-29f0be9474df tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1722 microversion: 2.20 time: 0.473293 Jul 29 05:27:14.943671 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 429/818] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:14 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1722 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:27:15.078207 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-f42fcaab-9064-4be4-8e34-5ccee440e69f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "POST /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.379401 Jul 29 05:27:15.079019 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 390/819] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Jul 29 05:27:14 2022] POST /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/os-volume_attachments => generated 194 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:27:15.619486 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-1c70be06-3798-43fe-a9ae-ef68c291c11f req-cce4aec6-5158-47d3-8eb5-4e4c904d3468 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7d28599-67a9-4e84-a44d-79f1a6bf728f", "tag": "c7e12f70-c8c8-48ec-9fd7-5a69b095e812"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:27:15.630681 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-1c70be06-3798-43fe-a9ae-ef68c291c11f req-cce4aec6-5158-47d3-8eb5-4e4c904d3468 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:15.631120 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-1c70be06-3798-43fe-a9ae-ef68c291c11f req-cce4aec6-5158-47d3-8eb5-4e4c904d3468 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:15.650565 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-1c70be06-3798-43fe-a9ae-ef68c291c11f req-cce4aec6-5158-47d3-8eb5-4e4c904d3468 service nova] Creating event network-changed:c7e12f70-c8c8-48ec-9fd7-5a69b095e812 for instance c7d28599-67a9-4e84-a44d-79f1a6bf728f on hv-cinder-85127 Jul 29 05:27:15.660728 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-1c70be06-3798-43fe-a9ae-ef68c291c11f req-cce4aec6-5158-47d3-8eb5-4e4c904d3468 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128529 Jul 29 05:27:15.661755 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 430/820] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:27:15.697601 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-c652a71f-1eb3-4098-b992-8d5f726072f3 tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] Calling method '.version_select at 0x7fa63ab0b700>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:15.780208 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-c652a71f-1eb3-4098-b992-8d5f726072f3 tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/f0fd3745-1229-4ae5-bd0a-604a37b6b3a6" status: 200 len: 345 microversion: 2.1 time: 0.088343 Jul 29 05:27:15.781324 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 391/821] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Jul 29 05:27:15 2022] GET /compute/v2.1/os-volumes/f0fd3745-1229-4ae5-bd0a-604a37b6b3a6 => generated 345 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:27:15.800175 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-82077d16-0fd6-4cb1-9a10-cec874537ae2 tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] Action: 'create', calling method: .version_select at 0x7fa63ac265e0>, body: {"snapshot": {"volume_id": "f0fd3745-1229-4ae5-bd0a-604a37b6b3a6", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-480332204"}} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:27:15.967812 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-3f3b4429-0683-4895-a354-59ce0a719536 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:15.968710 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-3f3b4429-0683-4895-a354-59ce0a719536 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:15.981578 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3f3b4429-0683-4895-a354-59ce0a719536 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:15.984646 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3f3b4429-0683-4895-a354-59ce0a719536 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:15.986174 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3f3b4429-0683-4895-a354-59ce0a719536 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:15.986702 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3f3b4429-0683-4895-a354-59ce0a719536 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:16.106925 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-82077d16-0fd6-4cb1-9a10-cec874537ae2 tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] 10.222.0.49 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.314960 Jul 29 05:27:16.108624 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 431/822] 10.222.0.49 () {60 vars in 1162 bytes} [Fri Jul 29 05:27:15 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:27:16.122227 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-acec24c6-f61d-4f20-b2ea-aac6940d5081 tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] Calling method '.version_select at 0x7fa63abd8160>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:16.166713 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-acec24c6-f61d-4f20-b2ea-aac6940d5081 tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/b3bcf942-a328-433d-957d-63a28bac23c1" status: 200 len: 286 microversion: 2.1 time: 0.050276 Jul 29 05:27:16.172745 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 432/823] 10.222.0.49 () {58 vars in 1251 bytes} [Fri Jul 29 05:27:16 2022] GET /compute/v2.1/os-snapshots/b3bcf942-a328-433d-957d-63a28bac23c1 => generated 286 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:27:16.188861 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-cf25c21c-306e-43ce-a133-61b2bc4cd85a tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] Calling method '.version_select at 0x7fa63acb5ca0>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:16.257254 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-cf25c21c-306e-43ce-a133-61b2bc4cd85a tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.075577 Jul 29 05:27:16.259176 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 433/824] 10.222.0.49 () {58 vars in 1140 bytes} [Fri Jul 29 05:27:16 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:27:16.274702 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-e7bf71b7-2748-4160-b141-48b7c357786b tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] Calling method '.version_select at 0x7fa63ac6c160>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:16.333987 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-e7bf71b7-2748-4160-b141-48b7c357786b tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/b3bcf942-a328-433d-957d-63a28bac23c1" status: 200 len: 286 microversion: 2.1 time: 0.066384 Jul 29 05:27:16.337821 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 434/825] 10.222.0.49 () {58 vars in 1251 bytes} [Fri Jul 29 05:27:16 2022] GET /compute/v2.1/os-snapshots/b3bcf942-a328-433d-957d-63a28bac23c1 => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:27:16.349323 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-3f3b4429-0683-4895-a354-59ce0a719536 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:16.364865 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-3f3b4429-0683-4895-a354-59ce0a719536 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:16.368310 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-3f3b4429-0683-4895-a354-59ce0a719536 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:16.371486 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-3f3b4429-0683-4895-a354-59ce0a719536 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1722 microversion: 2.20 time: 0.407842 Jul 29 05:27:16.372981 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 392/826] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:15 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1722 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:27:17.353634 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-505167be-c426-4d1d-b8b7-f72b16a7c499 tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] Calling method '.version_select at 0x7fa63aae59d0>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:17.397097 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-c8649f48-10bb-4119-be79-479a316ddce7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:17.398043 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-c8649f48-10bb-4119-be79-479a316ddce7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:17.402335 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-505167be-c426-4d1d-b8b7-f72b16a7c499 tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/b3bcf942-a328-433d-957d-63a28bac23c1" status: 200 len: 286 microversion: 2.1 time: 0.053900 Jul 29 05:27:17.403168 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 435/827] 10.222.0.49 () {58 vars in 1251 bytes} [Fri Jul 29 05:27:17 2022] GET /compute/v2.1/os-snapshots/b3bcf942-a328-433d-957d-63a28bac23c1 => generated 286 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:27:17.406204 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c8649f48-10bb-4119-be79-479a316ddce7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:17.406779 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c8649f48-10bb-4119-be79-479a316ddce7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:17.408569 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c8649f48-10bb-4119-be79-479a316ddce7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:17.409176 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c8649f48-10bb-4119-be79-479a316ddce7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:17.552973 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-c8649f48-10bb-4119-be79-479a316ddce7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:17.561856 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-c8649f48-10bb-4119-be79-479a316ddce7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:17.563387 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-c8649f48-10bb-4119-be79-479a316ddce7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:17.565342 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-c8649f48-10bb-4119-be79-479a316ddce7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1722 microversion: 2.20 time: 0.172683 Jul 29 05:27:17.565924 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 393/828] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:17 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:27:18.422832 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-b274f14c-dc34-4592-8d52-1ee4d59f8ccd tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] Calling method '.version_select at 0x7fa63ac741f0>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:18.462326 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-b274f14c-dc34-4592-8d52-1ee4d59f8ccd tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/b3bcf942-a328-433d-957d-63a28bac23c1" status: 200 len: 286 microversion: 2.1 time: 0.046732 Jul 29 05:27:18.462921 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 436/829] 10.222.0.49 () {58 vars in 1251 bytes} [Fri Jul 29 05:27:18 2022] GET /compute/v2.1/os-snapshots/b3bcf942-a328-433d-957d-63a28bac23c1 => generated 286 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:27:18.590869 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-e233fc58-d5d2-4b4b-acec-b73322966aab tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:18.591529 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-e233fc58-d5d2-4b4b-acec-b73322966aab tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:18.599236 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e233fc58-d5d2-4b4b-acec-b73322966aab tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:18.599733 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e233fc58-d5d2-4b4b-acec-b73322966aab tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:18.600524 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e233fc58-d5d2-4b4b-acec-b73322966aab tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:18.600965 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e233fc58-d5d2-4b4b-acec-b73322966aab tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:18.750898 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-e233fc58-d5d2-4b4b-acec-b73322966aab tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:18.760162 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-e233fc58-d5d2-4b4b-acec-b73322966aab tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:18.761684 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-e233fc58-d5d2-4b4b-acec-b73322966aab tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:18.762874 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-e233fc58-d5d2-4b4b-acec-b73322966aab tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1722 microversion: 2.20 time: 0.177774 Jul 29 05:27:18.763473 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 394/830] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:18 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:27:19.476427 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-209e28e2-f60f-4041-92e8-1432533b3b8a tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] Calling method '.version_select at 0x7fa63abd8160>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:19.511468 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-209e28e2-f60f-4041-92e8-1432533b3b8a tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/b3bcf942-a328-433d-957d-63a28bac23c1" status: 200 len: 287 microversion: 2.1 time: 0.039947 Jul 29 05:27:19.512311 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 437/831] 10.222.0.49 () {58 vars in 1251 bytes} [Fri Jul 29 05:27:19 2022] GET /compute/v2.1/os-snapshots/b3bcf942-a328-433d-957d-63a28bac23c1 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:27:19.524441 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-bcfe80da-53e1-476f-b870-54a4375c41f1 tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] Calling method '.version_select at 0x7fa63ab2aee0>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:19.590821 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-bcfe80da-53e1-476f-b870-54a4375c41f1 tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] 10.222.0.49 "DELETE /compute/v2.1/os-snapshots/b3bcf942-a328-433d-957d-63a28bac23c1" status: 202 len: 0 microversion: 2.1 time: 0.070074 Jul 29 05:27:19.591501 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 395/832] 10.222.0.49 () {58 vars in 1254 bytes} [Fri Jul 29 05:27:19 2022] DELETE /compute/v2.1/os-snapshots/b3bcf942-a328-433d-957d-63a28bac23c1 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 05:27:19.601481 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-826ce3ec-2049-4497-a946-9127c78e6f8f tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] Calling method '.version_select at 0x7fa63acb5dc0>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:19.646801 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-826ce3ec-2049-4497-a946-9127c78e6f8f tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/b3bcf942-a328-433d-957d-63a28bac23c1" status: 200 len: 286 microversion: 2.1 time: 0.049189 Jul 29 05:27:19.647416 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 438/833] 10.222.0.49 () {58 vars in 1251 bytes} [Fri Jul 29 05:27:19 2022] GET /compute/v2.1/os-snapshots/b3bcf942-a328-433d-957d-63a28bac23c1 => generated 286 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:27:19.790360 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-9b06d194-171f-43d4-a629-b0c04a557fed tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:19.791171 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-9b06d194-171f-43d4-a629-b0c04a557fed tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:19.803854 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9b06d194-171f-43d4-a629-b0c04a557fed tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:19.804510 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9b06d194-171f-43d4-a629-b0c04a557fed tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:19.805458 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9b06d194-171f-43d4-a629-b0c04a557fed tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:19.805999 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9b06d194-171f-43d4-a629-b0c04a557fed tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:19.963494 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-9b06d194-171f-43d4-a629-b0c04a557fed tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:19.972402 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-9b06d194-171f-43d4-a629-b0c04a557fed tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:19.973934 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-9b06d194-171f-43d4-a629-b0c04a557fed tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:19.975293 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-9b06d194-171f-43d4-a629-b0c04a557fed tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1722 microversion: 2.20 time: 0.190704 Jul 29 05:27:19.976207 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 396/834] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:19 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:27:20.661960 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-ccb1e370-d926-4f7e-8475-07edbe12b100 tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] Calling method '.version_select at 0x7fa63acf8550>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:20.697688 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.wsgi [None req-ccb1e370-d926-4f7e-8475-07edbe12b100 tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] HTTP exception thrown: Snapshot b3bcf942-a328-433d-957d-63a28bac23c1 could not be found. Jul 29 05:27:20.701361 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-ccb1e370-d926-4f7e-8475-07edbe12b100 tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] Request method failure captured: Jul 29 05:27:20.701361 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: request: GET /compute/v2.1/os-snapshots/b3bcf942-a328-433d-957d-63a28bac23c1 HTTP/1.1 Jul 29 05:27:20.701361 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept: application/json Jul 29 05:27:20.701361 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept-Encoding: identity Jul 29 05:27:20.701361 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Connection: close Jul 29 05:27:20.701361 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Length: 0 Jul 29 05:27:20.701361 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Type: application/json Jul 29 05:27:20.701361 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Host: 10.222.0.49 Jul 29 05:27:20.701361 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Openstack-System-Scope: None Jul 29 05:27:20.701361 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: User-Agent: python-urllib3/1.26.10 Jul 29 05:27:20.701361 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Auth-Token: gAAAAABi42-xZWf-iMwF0nEg57A__xnkIjAmaTfcAJ862aghCk02kiJh5RbZvD5lpr_q-WWZMdZ9XfPagsOFUAU6lafSZpGu9Eo_0IccHgAzO3jWSOLBw1V6BR1x7H-JOvu0XqTW3Gx7_wwBtzQC0FzvyILaD9l7jnfokWU71Os7ndtJa5H7Dxg Jul 29 05:27:20.701361 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Id: None Jul 29 05:27:20.701361 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Name: None Jul 29 05:27:20.701361 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Identity-Status: Confirmed Jul 29 05:27:20.701361 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Is-Admin-Project: True Jul 29 05:27:20.701361 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Id: default Jul 29 05:27:20.701361 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Name: Default Jul 29 05:27:20.701361 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Id: b80e9efe673244a79cf0270be1323e0e Jul 29 05:27:20.701361 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-502039100 Jul 29 05:27:20.701361 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Role: member,reader Jul 29 05:27:20.701361 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Roles: member,reader Jul 29 05:27:20.702751 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b80e9efe673244a79cf0270be1323e0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b80e9efe673244a79cf0270be1323e0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b80e9efe673244a79cf0270be1323e0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b80e9efe673244a79cf0270be1323e0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:27:20.702751 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant: tempest-VolumesSnapshotsTestJSON-502039100 Jul 29 05:27:20.702751 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Id: b80e9efe673244a79cf0270be1323e0e Jul 29 05:27:20.702751 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-502039100 Jul 29 05:27:20.702751 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User: tempest-VolumesSnapshotsTestJSON-502039100-project Jul 29 05:27:20.702751 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Id: default Jul 29 05:27:20.702751 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Name: Default Jul 29 05:27:20.702751 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Id: 7da79af963a84c07aae68d86aadbcd4f Jul 29 05:27:20.702751 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Name: tempest-VolumesSnapshotsTestJSON-502039100-project Jul 29 05:27:20.702751 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: method: Jul 29 05:27:20.702751 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: exception: Snapshot b3bcf942-a328-433d-957d-63a28bac23c1 could not be found. Jul 29 05:27:20.702751 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: action_args: {'id': 'b3bcf942-a328-433d-957d-63a28bac23c1'} Jul 29 05:27:20.702751 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:27:20.703622 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:20.703622 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 29 05:27:20.703622 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 29 05:27:20.703622 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 29 05:27:20.703622 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 29 05:27:20.703622 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 29 05:27:20.703622 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 29 05:27:20.703622 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 05:27:20.703622 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 05:27:20.703622 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 05:27:20.703622 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 05:27:20.703622 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 05:27:20.703622 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 05:27:20.703622 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 05:27:20.703622 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 05:27:20.703622 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b3bcf942-a328-433d-957d-63a28bac23c1 could not be found. (HTTP 404) (Request-ID: req-cc064c63-f19f-4d3a-a03a-1a150aef5afe) Jul 29 05:27:20.703622 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:20.703622 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:27:20.705317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:20.705317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:20.705317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 29 05:27:20.705317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 29 05:27:20.705317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 05:27:20.705317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 05:27:20.705317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 29 05:27:20.705317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 29 05:27:20.705317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 05:27:20.705317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 05:27:20.705317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 29 05:27:20.705317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 29 05:27:20.705317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 29 05:27:20.705317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 29 05:27:20.705317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 29 05:27:20.705317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 29 05:27:20.705317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 05:27:20.705317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 05:27:20.705317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 05:27:20.706418 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 05:27:20.706418 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 05:27:20.706418 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 05:27:20.706418 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 05:27:20.706418 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 05:27:20.706418 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b3bcf942-a328-433d-957d-63a28bac23c1 could not be found. Jul 29 05:27:20.706418 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:20.706418 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:27:20.706418 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:20.706418 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:20.706418 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:27:20.706418 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:27:20.706418 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:27:20.706418 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:27:20.706418 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 05:27:20.706418 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 05:27:20.706418 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:27:20.706418 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:27:20.706418 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 29 05:27:20.706418 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:27:20.707611 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b3bcf942-a328-433d-957d-63a28bac23c1 could not be found. Jul 29 05:27:20.707611 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:20.707611 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:27:20.707611 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:20.707611 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:20.707611 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:27:20.707611 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:27:20.707611 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:27:20.707611 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:27:20.707611 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b3bcf942-a328-433d-957d-63a28bac23c1 could not be found. Jul 29 05:27:20.707611 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:20.707611 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-ccb1e370-d926-4f7e-8475-07edbe12b100 tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] Returning 404 to user: Snapshot b3bcf942-a328-433d-957d-63a28bac23c1 could not be found. {{(pid=117821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:27:20.707611 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-ccb1e370-d926-4f7e-8475-07edbe12b100 tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/b3bcf942-a328-433d-957d-63a28bac23c1" status: 404 len: 111 microversion: 2.1 time: 0.047088 Jul 29 05:27:20.707611 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 439/835] 10.222.0.49 () {58 vars in 1251 bytes} [Fri Jul 29 05:27:20 2022] GET /compute/v2.1/os-snapshots/b3bcf942-a328-433d-957d-63a28bac23c1 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:27:20.715767 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-28431d4e-701d-458d-afb2-5cd024e590b2 tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] Calling method '.version_select at 0x7fa63ab79310>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:20.786141 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-28431d4e-701d-458d-afb2-5cd024e590b2 tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/f0fd3745-1229-4ae5-bd0a-604a37b6b3a6" status: 202 len: 0 microversion: 2.1 time: 0.074444 Jul 29 05:27:20.786801 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 397/836] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Jul 29 05:27:20 2022] DELETE /compute/v2.1/os-volumes/f0fd3745-1229-4ae5-bd0a-604a37b6b3a6 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 05:27:20.796884 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-9ae8e060-c221-4f74-8fc5-1a75bb2fb750 tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] Calling method '.version_select at 0x7fa63ac15d30>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:20.850511 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-9ae8e060-c221-4f74-8fc5-1a75bb2fb750 tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/f0fd3745-1229-4ae5-bd0a-604a37b6b3a6" status: 200 len: 344 microversion: 2.1 time: 0.057867 Jul 29 05:27:20.851091 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 440/837] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Jul 29 05:27:20 2022] GET /compute/v2.1/os-volumes/f0fd3745-1229-4ae5-bd0a-604a37b6b3a6 => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:27:21.003109 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-61486677-4996-4f80-a5fc-b2c5b13b1733 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:21.003983 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-61486677-4996-4f80-a5fc-b2c5b13b1733 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:21.010865 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-61486677-4996-4f80-a5fc-b2c5b13b1733 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:21.011327 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-61486677-4996-4f80-a5fc-b2c5b13b1733 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:21.012597 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-61486677-4996-4f80-a5fc-b2c5b13b1733 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:21.012597 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-61486677-4996-4f80-a5fc-b2c5b13b1733 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:21.021552 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-10b5b21e-fa91-4558-a4a0-d11f33f7fcc9 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:21.022411 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-10b5b21e-fa91-4558-a4a0-d11f33f7fcc9 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:21.033755 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-10b5b21e-fa91-4558-a4a0-d11f33f7fcc9 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:21.034441 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-10b5b21e-fa91-4558-a4a0-d11f33f7fcc9 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:21.035615 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-10b5b21e-fa91-4558-a4a0-d11f33f7fcc9 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:21.036259 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-10b5b21e-fa91-4558-a4a0-d11f33f7fcc9 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:21.078333 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-10b5b21e-fa91-4558-a4a0-d11f33f7fcc9 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9/ips" status: 200 len: 144 microversion: 2.1 time: 0.064112 Jul 29 05:27:21.078967 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 441/838] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Jul 29 05:27:21 2022] GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9/ips => generated 144 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:27:21.202771 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-61486677-4996-4f80-a5fc-b2c5b13b1733 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:21.214132 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-61486677-4996-4f80-a5fc-b2c5b13b1733 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:21.215710 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-61486677-4996-4f80-a5fc-b2c5b13b1733 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:21.217106 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-61486677-4996-4f80-a5fc-b2c5b13b1733 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1722 microversion: 2.20 time: 0.219642 Jul 29 05:27:21.217690 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 398/839] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:20 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:27:21.865971 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-0e216840-4e67-4113-9fc3-81492eb18355 tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] Calling method '.version_select at 0x7fa63ac2d9d0>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:21.915499 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.wsgi [None req-0e216840-4e67-4113-9fc3-81492eb18355 tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] HTTP exception thrown: Volume f0fd3745-1229-4ae5-bd0a-604a37b6b3a6 could not be found. Jul 29 05:27:21.918318 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-0e216840-4e67-4113-9fc3-81492eb18355 tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] Request method failure captured: Jul 29 05:27:21.918318 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: request: GET /compute/v2.1/os-volumes/f0fd3745-1229-4ae5-bd0a-604a37b6b3a6 HTTP/1.1 Jul 29 05:27:21.918318 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept: application/json Jul 29 05:27:21.918318 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept-Encoding: identity Jul 29 05:27:21.918318 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Connection: close Jul 29 05:27:21.918318 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Length: 0 Jul 29 05:27:21.918318 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Type: application/json Jul 29 05:27:21.918318 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Host: 10.222.0.49 Jul 29 05:27:21.918318 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Openstack-System-Scope: None Jul 29 05:27:21.918318 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: User-Agent: python-urllib3/1.26.10 Jul 29 05:27:21.918318 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Auth-Token: gAAAAABi42-xZWf-iMwF0nEg57A__xnkIjAmaTfcAJ862aghCk02kiJh5RbZvD5lpr_q-WWZMdZ9XfPagsOFUAU6lafSZpGu9Eo_0IccHgAzO3jWSOLBw1V6BR1x7H-JOvu0XqTW3Gx7_wwBtzQC0FzvyILaD9l7jnfokWU71Os7ndtJa5H7Dxg Jul 29 05:27:21.918318 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Id: None Jul 29 05:27:21.918318 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Name: None Jul 29 05:27:21.918318 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Identity-Status: Confirmed Jul 29 05:27:21.918318 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Is-Admin-Project: True Jul 29 05:27:21.918318 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Id: default Jul 29 05:27:21.918318 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Name: Default Jul 29 05:27:21.918318 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Id: b80e9efe673244a79cf0270be1323e0e Jul 29 05:27:21.918318 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-502039100 Jul 29 05:27:21.918318 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Role: member,reader Jul 29 05:27:21.918318 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Roles: member,reader Jul 29 05:27:21.921275 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b80e9efe673244a79cf0270be1323e0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b80e9efe673244a79cf0270be1323e0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b80e9efe673244a79cf0270be1323e0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b80e9efe673244a79cf0270be1323e0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:27:21.921275 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant: tempest-VolumesSnapshotsTestJSON-502039100 Jul 29 05:27:21.921275 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Id: b80e9efe673244a79cf0270be1323e0e Jul 29 05:27:21.921275 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-502039100 Jul 29 05:27:21.921275 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User: tempest-VolumesSnapshotsTestJSON-502039100-project Jul 29 05:27:21.921275 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Id: default Jul 29 05:27:21.921275 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Name: Default Jul 29 05:27:21.921275 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Id: 7da79af963a84c07aae68d86aadbcd4f Jul 29 05:27:21.921275 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Name: tempest-VolumesSnapshotsTestJSON-502039100-project Jul 29 05:27:21.921275 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: method: Jul 29 05:27:21.921275 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: exception: Volume f0fd3745-1229-4ae5-bd0a-604a37b6b3a6 could not be found. Jul 29 05:27:21.921275 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: action_args: {'id': 'f0fd3745-1229-4ae5-bd0a-604a37b6b3a6'} Jul 29 05:27:21.921275 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:27:21.923092 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:21.923092 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 05:27:21.923092 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 05:27:21.923092 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 05:27:21.923092 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 05:27:21.923092 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 05:27:21.923092 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 05:27:21.923092 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 05:27:21.923092 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 05:27:21.923092 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 05:27:21.923092 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 05:27:21.923092 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 05:27:21.923092 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 05:27:21.923092 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 05:27:21.923092 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 05:27:21.923092 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f0fd3745-1229-4ae5-bd0a-604a37b6b3a6 could not be found. (HTTP 404) (Request-ID: req-4d7d6514-bf14-4578-86d1-5e4f0b96ee26) Jul 29 05:27:21.923092 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:21.923092 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:27:21.923092 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:21.926025 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:21.926025 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 29 05:27:21.926025 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 29 05:27:21.926025 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 05:27:21.926025 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 05:27:21.926025 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 05:27:21.926025 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 05:27:21.926025 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 05:27:21.926025 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 05:27:21.926025 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 05:27:21.926025 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 05:27:21.926025 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 05:27:21.926025 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 05:27:21.926025 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 05:27:21.926025 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 05:27:21.926025 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 05:27:21.926025 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 05:27:21.926025 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 05:27:21.926025 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 05:27:21.928994 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 05:27:21.928994 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 05:27:21.928994 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 05:27:21.928994 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 05:27:21.928994 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f0fd3745-1229-4ae5-bd0a-604a37b6b3a6 could not be found. Jul 29 05:27:21.928994 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:21.928994 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:27:21.928994 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:21.928994 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:21.928994 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:27:21.928994 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:27:21.928994 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:27:21.928994 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:27:21.928994 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 05:27:21.928994 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 05:27:21.928994 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:27:21.928994 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:27:21.928994 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 29 05:27:21.928994 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:27:21.931765 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f0fd3745-1229-4ae5-bd0a-604a37b6b3a6 could not be found. Jul 29 05:27:21.931765 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:21.931765 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:27:21.931765 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:21.931765 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:21.931765 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:27:21.931765 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:27:21.931765 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:27:21.931765 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:27:21.931765 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f0fd3745-1229-4ae5-bd0a-604a37b6b3a6 could not be found. Jul 29 05:27:21.931765 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:21.931765 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-0e216840-4e67-4113-9fc3-81492eb18355 tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] Returning 404 to user: Volume f0fd3745-1229-4ae5-bd0a-604a37b6b3a6 could not be found. {{(pid=117821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:27:21.931765 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-0e216840-4e67-4113-9fc3-81492eb18355 tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/f0fd3745-1229-4ae5-bd0a-604a37b6b3a6" status: 404 len: 109 microversion: 2.1 time: 0.058738 Jul 29 05:27:21.931765 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 442/840] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Jul 29 05:27:21 2022] GET /compute/v2.1/os-volumes/f0fd3745-1229-4ae5-bd0a-604a37b6b3a6 => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 05:27:21.934244 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-2fd69e82-f65f-4774-9a2c-a271612b3db0 tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] Calling method '.version_select at 0x7fa63ab224c0>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:21.976243 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.wsgi [None req-2fd69e82-f65f-4774-9a2c-a271612b3db0 tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] HTTP exception thrown: Volume f0fd3745-1229-4ae5-bd0a-604a37b6b3a6 could not be found. Jul 29 05:27:21.982552 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-2fd69e82-f65f-4774-9a2c-a271612b3db0 tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] Request method failure captured: Jul 29 05:27:21.982552 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: request: DELETE /compute/v2.1/os-volumes/f0fd3745-1229-4ae5-bd0a-604a37b6b3a6 HTTP/1.1 Jul 29 05:27:21.982552 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept: application/json Jul 29 05:27:21.982552 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept-Encoding: identity Jul 29 05:27:21.982552 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Connection: close Jul 29 05:27:21.982552 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Length: 0 Jul 29 05:27:21.982552 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Type: application/json Jul 29 05:27:21.982552 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Host: 10.222.0.49 Jul 29 05:27:21.982552 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Openstack-System-Scope: None Jul 29 05:27:21.982552 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: User-Agent: python-urllib3/1.26.10 Jul 29 05:27:21.982552 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Auth-Token: gAAAAABi42-xZWf-iMwF0nEg57A__xnkIjAmaTfcAJ862aghCk02kiJh5RbZvD5lpr_q-WWZMdZ9XfPagsOFUAU6lafSZpGu9Eo_0IccHgAzO3jWSOLBw1V6BR1x7H-JOvu0XqTW3Gx7_wwBtzQC0FzvyILaD9l7jnfokWU71Os7ndtJa5H7Dxg Jul 29 05:27:21.982552 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Id: None Jul 29 05:27:21.982552 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Name: None Jul 29 05:27:21.982552 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Identity-Status: Confirmed Jul 29 05:27:21.982552 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Is-Admin-Project: True Jul 29 05:27:21.982552 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Id: default Jul 29 05:27:21.982552 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Name: Default Jul 29 05:27:21.982552 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Id: b80e9efe673244a79cf0270be1323e0e Jul 29 05:27:21.982552 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-502039100 Jul 29 05:27:21.982552 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Role: member,reader Jul 29 05:27:21.982552 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Roles: member,reader Jul 29 05:27:21.984952 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b80e9efe673244a79cf0270be1323e0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b80e9efe673244a79cf0270be1323e0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b80e9efe673244a79cf0270be1323e0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b80e9efe673244a79cf0270be1323e0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:27:21.984952 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant: tempest-VolumesSnapshotsTestJSON-502039100 Jul 29 05:27:21.984952 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Id: b80e9efe673244a79cf0270be1323e0e Jul 29 05:27:21.984952 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-502039100 Jul 29 05:27:21.984952 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User: tempest-VolumesSnapshotsTestJSON-502039100-project Jul 29 05:27:21.984952 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Id: default Jul 29 05:27:21.984952 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Name: Default Jul 29 05:27:21.984952 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Id: 7da79af963a84c07aae68d86aadbcd4f Jul 29 05:27:21.984952 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Name: tempest-VolumesSnapshotsTestJSON-502039100-project Jul 29 05:27:21.984952 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: method: Jul 29 05:27:21.984952 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: exception: Volume f0fd3745-1229-4ae5-bd0a-604a37b6b3a6 could not be found. Jul 29 05:27:21.984952 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: action_args: {'id': 'f0fd3745-1229-4ae5-bd0a-604a37b6b3a6'} Jul 29 05:27:21.984952 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:27:21.986228 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:21.986228 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 05:27:21.986228 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 05:27:21.986228 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 05:27:21.986228 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 05:27:21.986228 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 05:27:21.986228 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 05:27:21.986228 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 05:27:21.986228 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 05:27:21.986228 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 05:27:21.986228 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 05:27:21.986228 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 05:27:21.986228 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 05:27:21.986228 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 05:27:21.986228 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 05:27:21.986228 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f0fd3745-1229-4ae5-bd0a-604a37b6b3a6 could not be found. (HTTP 404) (Request-ID: req-a7904c4a-ec93-44fb-a3ef-18272637aedf) Jul 29 05:27:21.986228 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:27:21.986228 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:27:21.986228 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:27:21.987517 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:21.987517 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 29 05:27:21.987517 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 29 05:27:21.987517 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 05:27:21.987517 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 05:27:21.987517 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 05:27:21.987517 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 05:27:21.987517 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 05:27:21.987517 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 05:27:21.987517 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 05:27:21.987517 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 05:27:21.987517 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 05:27:21.987517 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 05:27:21.987517 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 05:27:21.987517 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 05:27:21.987517 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 05:27:21.987517 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 05:27:21.987517 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 05:27:21.987517 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 05:27:21.989796 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 05:27:21.989796 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 05:27:21.989796 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 05:27:21.989796 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 05:27:21.989796 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f0fd3745-1229-4ae5-bd0a-604a37b6b3a6 could not be found. Jul 29 05:27:21.989796 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:27:21.989796 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:27:21.989796 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:27:21.989796 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:21.989796 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:27:21.989796 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:27:21.989796 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:27:21.989796 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:27:21.989796 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 05:27:21.989796 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 05:27:21.989796 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:27:21.989796 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:27:21.989796 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 29 05:27:21.989796 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:27:21.992084 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f0fd3745-1229-4ae5-bd0a-604a37b6b3a6 could not be found. Jul 29 05:27:21.992084 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:27:21.992084 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:27:21.992084 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:27:21.992084 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:21.992084 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:27:21.992084 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:27:21.992084 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:27:21.992084 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:27:21.992084 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f0fd3745-1229-4ae5-bd0a-604a37b6b3a6 could not be found. Jul 29 05:27:21.992084 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:27:21.992084 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-2fd69e82-f65f-4774-9a2c-a271612b3db0 tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] Returning 404 to user: Volume f0fd3745-1229-4ae5-bd0a-604a37b6b3a6 could not be found. {{(pid=117820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:27:21.992084 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-2fd69e82-f65f-4774-9a2c-a271612b3db0 tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/f0fd3745-1229-4ae5-bd0a-604a37b6b3a6" status: 404 len: 109 microversion: 2.1 time: 0.056007 Jul 29 05:27:21.992084 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 399/841] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Jul 29 05:27:21 2022] DELETE /compute/v2.1/os-volumes/f0fd3745-1229-4ae5-bd0a-604a37b6b3a6 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 05:27:21.999516 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-8a1ca057-f6e4-4ab1-a0a8-bd3f2fa75604 tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] Calling method '.version_select at 0x7fa63ac6c790>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:22.030849 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.wsgi [None req-8a1ca057-f6e4-4ab1-a0a8-bd3f2fa75604 tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] HTTP exception thrown: Volume f0fd3745-1229-4ae5-bd0a-604a37b6b3a6 could not be found. Jul 29 05:27:22.033029 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-8a1ca057-f6e4-4ab1-a0a8-bd3f2fa75604 tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] Request method failure captured: Jul 29 05:27:22.033029 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: request: GET /compute/v2.1/os-volumes/f0fd3745-1229-4ae5-bd0a-604a37b6b3a6 HTTP/1.1 Jul 29 05:27:22.033029 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept: application/json Jul 29 05:27:22.033029 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept-Encoding: identity Jul 29 05:27:22.033029 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Connection: close Jul 29 05:27:22.033029 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Length: 0 Jul 29 05:27:22.033029 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Type: application/json Jul 29 05:27:22.033029 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Host: 10.222.0.49 Jul 29 05:27:22.033029 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Openstack-System-Scope: None Jul 29 05:27:22.033029 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: User-Agent: python-urllib3/1.26.10 Jul 29 05:27:22.033029 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Auth-Token: gAAAAABi42-xZWf-iMwF0nEg57A__xnkIjAmaTfcAJ862aghCk02kiJh5RbZvD5lpr_q-WWZMdZ9XfPagsOFUAU6lafSZpGu9Eo_0IccHgAzO3jWSOLBw1V6BR1x7H-JOvu0XqTW3Gx7_wwBtzQC0FzvyILaD9l7jnfokWU71Os7ndtJa5H7Dxg Jul 29 05:27:22.033029 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Id: None Jul 29 05:27:22.033029 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Name: None Jul 29 05:27:22.033029 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Identity-Status: Confirmed Jul 29 05:27:22.033029 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Is-Admin-Project: True Jul 29 05:27:22.033029 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Id: default Jul 29 05:27:22.033029 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Name: Default Jul 29 05:27:22.033029 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Id: b80e9efe673244a79cf0270be1323e0e Jul 29 05:27:22.033029 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-502039100 Jul 29 05:27:22.033029 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Role: member,reader Jul 29 05:27:22.033029 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Roles: member,reader Jul 29 05:27:22.035835 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b80e9efe673244a79cf0270be1323e0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b80e9efe673244a79cf0270be1323e0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b80e9efe673244a79cf0270be1323e0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b80e9efe673244a79cf0270be1323e0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:27:22.035835 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant: tempest-VolumesSnapshotsTestJSON-502039100 Jul 29 05:27:22.035835 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Id: b80e9efe673244a79cf0270be1323e0e Jul 29 05:27:22.035835 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-502039100 Jul 29 05:27:22.035835 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User: tempest-VolumesSnapshotsTestJSON-502039100-project Jul 29 05:27:22.035835 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Id: default Jul 29 05:27:22.035835 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Name: Default Jul 29 05:27:22.035835 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Id: 7da79af963a84c07aae68d86aadbcd4f Jul 29 05:27:22.035835 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Name: tempest-VolumesSnapshotsTestJSON-502039100-project Jul 29 05:27:22.035835 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: method: Jul 29 05:27:22.035835 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: exception: Volume f0fd3745-1229-4ae5-bd0a-604a37b6b3a6 could not be found. Jul 29 05:27:22.035835 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: action_args: {'id': 'f0fd3745-1229-4ae5-bd0a-604a37b6b3a6'} Jul 29 05:27:22.035835 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:27:22.037340 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:22.037340 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 05:27:22.037340 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 05:27:22.037340 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 05:27:22.037340 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 05:27:22.037340 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 05:27:22.037340 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 05:27:22.037340 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 05:27:22.037340 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 05:27:22.037340 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 05:27:22.037340 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 05:27:22.037340 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 05:27:22.037340 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 05:27:22.037340 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 05:27:22.037340 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 05:27:22.037340 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f0fd3745-1229-4ae5-bd0a-604a37b6b3a6 could not be found. (HTTP 404) (Request-ID: req-2b755212-b6c2-4d82-9ae6-e0d2c6edcaa0) Jul 29 05:27:22.037340 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:22.037340 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:27:22.037340 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:22.039642 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:22.039642 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 29 05:27:22.039642 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 29 05:27:22.039642 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 05:27:22.039642 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 05:27:22.039642 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 05:27:22.039642 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 05:27:22.039642 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 05:27:22.039642 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 05:27:22.039642 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 05:27:22.039642 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 05:27:22.039642 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 05:27:22.039642 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 05:27:22.039642 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 05:27:22.039642 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 05:27:22.039642 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 05:27:22.039642 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 05:27:22.039642 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 05:27:22.039642 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 05:27:22.042782 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 05:27:22.042782 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 05:27:22.042782 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 05:27:22.042782 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 05:27:22.042782 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f0fd3745-1229-4ae5-bd0a-604a37b6b3a6 could not be found. Jul 29 05:27:22.042782 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:22.042782 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:27:22.042782 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:22.042782 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:22.042782 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:27:22.042782 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:27:22.042782 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:27:22.042782 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:27:22.042782 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 05:27:22.042782 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 05:27:22.042782 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:27:22.042782 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:27:22.042782 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 29 05:27:22.042782 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:27:22.045258 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f0fd3745-1229-4ae5-bd0a-604a37b6b3a6 could not be found. Jul 29 05:27:22.045258 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:22.045258 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:27:22.045258 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:22.045258 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:22.045258 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:27:22.045258 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:27:22.045258 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:27:22.045258 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:27:22.045258 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f0fd3745-1229-4ae5-bd0a-604a37b6b3a6 could not be found. Jul 29 05:27:22.045258 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:22.045258 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-8a1ca057-f6e4-4ab1-a0a8-bd3f2fa75604 tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] Returning 404 to user: Volume f0fd3745-1229-4ae5-bd0a-604a37b6b3a6 could not be found. {{(pid=117821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:27:22.045258 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-8a1ca057-f6e4-4ab1-a0a8-bd3f2fa75604 tempest-VolumesSnapshotsTestJSON-502039100 tempest-VolumesSnapshotsTestJSON-502039100-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/f0fd3745-1229-4ae5-bd0a-604a37b6b3a6" status: 404 len: 109 microversion: 2.1 time: 0.040898 Jul 29 05:27:22.045258 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 443/842] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Jul 29 05:27:21 2022] GET /compute/v2.1/os-volumes/f0fd3745-1229-4ae5-bd0a-604a37b6b3a6 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:27:22.243261 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-1d4ea3d3-7669-4442-b8d6-71c8c368b1ee tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:22.244076 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-1d4ea3d3-7669-4442-b8d6-71c8c368b1ee tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:22.253417 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1d4ea3d3-7669-4442-b8d6-71c8c368b1ee tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:22.254044 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1d4ea3d3-7669-4442-b8d6-71c8c368b1ee tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:22.254986 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1d4ea3d3-7669-4442-b8d6-71c8c368b1ee tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:22.255584 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1d4ea3d3-7669-4442-b8d6-71c8c368b1ee tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:22.461309 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-1d4ea3d3-7669-4442-b8d6-71c8c368b1ee tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:22.471034 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-1d4ea3d3-7669-4442-b8d6-71c8c368b1ee tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:22.472821 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-1d4ea3d3-7669-4442-b8d6-71c8c368b1ee tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:22.474036 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-1d4ea3d3-7669-4442-b8d6-71c8c368b1ee tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1722 microversion: 2.20 time: 0.235519 Jul 29 05:27:22.474608 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 400/843] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:22 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:27:22.576469 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell0:SELECT=2 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:27:22.580969 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-afd9f5c4-d2f4-40ce-a8fe-e80c815f40a7 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b5c78d1-fe5e-40e3-8a78-dd42bec09d9f"}} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:27:22.583478 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-afd9f5c4-d2f4-40ce-a8fe-e80c815f40a7 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:22.590678 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-afd9f5c4-d2f4-40ce-a8fe-e80c815f40a7 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:22.591132 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-afd9f5c4-d2f4-40ce-a8fe-e80c815f40a7 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:22.591968 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-afd9f5c4-d2f4-40ce-a8fe-e80c815f40a7 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:22.592413 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-afd9f5c4-d2f4-40ce-a8fe-e80c815f40a7 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:22.979275 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-2afc55e3-e73e-4de5-89f5-8773a9eff1ad tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:22.980527 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-2afc55e3-e73e-4de5-89f5-8773a9eff1ad tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:22.989689 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2afc55e3-e73e-4de5-89f5-8773a9eff1ad tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:22.990174 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2afc55e3-e73e-4de5-89f5-8773a9eff1ad tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:22.990966 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-afd9f5c4-d2f4-40ce-a8fe-e80c815f40a7 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "POST /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.414903 Jul 29 05:27:22.991723 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2afc55e3-e73e-4de5-89f5-8773a9eff1ad tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:22.992465 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 444/844] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Jul 29 05:27:22 2022] POST /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9/os-volume_attachments => generated 194 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:27:22.992787 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2afc55e3-e73e-4de5-89f5-8773a9eff1ad tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:23.491296 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-2afc55e3-e73e-4de5-89f5-8773a9eff1ad tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:23.508342 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-2afc55e3-e73e-4de5-89f5-8773a9eff1ad tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1594 microversion: 2.1 time: 0.533493 Jul 29 05:27:23.509657 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-3bc84a79-ec0e-4f71-9381-222d4a73c561 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:23.509818 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 401/845] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:22 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1594 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:27:23.510370 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-3bc84a79-ec0e-4f71-9381-222d4a73c561 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:23.518277 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3bc84a79-ec0e-4f71-9381-222d4a73c561 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:23.519024 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3bc84a79-ec0e-4f71-9381-222d4a73c561 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:23.520041 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3bc84a79-ec0e-4f71-9381-222d4a73c561 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:23.520638 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3bc84a79-ec0e-4f71-9381-222d4a73c561 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:23.709132 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-3bc84a79-ec0e-4f71-9381-222d4a73c561 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:23.723680 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-3bc84a79-ec0e-4f71-9381-222d4a73c561 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:23.727110 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-3bc84a79-ec0e-4f71-9381-222d4a73c561 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:23.729251 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-3bc84a79-ec0e-4f71-9381-222d4a73c561 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1722 microversion: 2.20 time: 0.223795 Jul 29 05:27:23.729882 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 445/846] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:23 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:27:24.378451 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-9399675a-5765-48d5-a8bd-2213d064f5d1 tempest-VolumesNegativeTest-1699008772 tempest-VolumesNegativeTest-1699008772-project] Action: 'create', calling method: .version_select at 0x7fa63ab220d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-387114901", "metadata": {"Type": "work"}}} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:27:24.390571 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-9399675a-5765-48d5-a8bd-2213d064f5d1 tempest-VolumesNegativeTest-1699008772 tempest-VolumesNegativeTest-1699008772-project] Request method failure captured: Jul 29 05:27:24.390571 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 29 05:27:24.390571 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept: application/json Jul 29 05:27:24.390571 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept-Encoding: identity Jul 29 05:27:24.390571 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Connection: close Jul 29 05:27:24.390571 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Length: 121 Jul 29 05:27:24.390571 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Type: application/json Jul 29 05:27:24.390571 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Host: 10.222.0.49 Jul 29 05:27:24.390571 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Openstack-System-Scope: None Jul 29 05:27:24.390571 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: User-Agent: python-urllib3/1.26.10 Jul 29 05:27:24.390571 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Auth-Token: gAAAAABi42-8C0Z4PHMhlxEb1xgVGoAeI4tAM0mHXiakEEO62TP4YpOGW3XBoKrnO7PMKXsG8LYXtH36HFZCQseRkahK3xIkvtSX1c2Nwr-7hAJgrpz4wifKvXlW89Lxhp9Dt4tewZwjBObNgL_BDd3m_Jn0kMgSUoLrKLjH6A_Nm0r8Ymo93kU Jul 29 05:27:24.390571 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Id: None Jul 29 05:27:24.390571 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Name: None Jul 29 05:27:24.390571 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Identity-Status: Confirmed Jul 29 05:27:24.390571 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Is-Admin-Project: True Jul 29 05:27:24.390571 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Id: default Jul 29 05:27:24.390571 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Name: Default Jul 29 05:27:24.390571 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Id: 4cd4d5a63dba4a98a8d496e70f3c34fe Jul 29 05:27:24.390571 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Name: tempest-VolumesNegativeTest-1699008772 Jul 29 05:27:24.390571 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Role: member,reader Jul 29 05:27:24.390571 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Roles: member,reader Jul 29 05:27:24.393589 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4cd4d5a63dba4a98a8d496e70f3c34fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4cd4d5a63dba4a98a8d496e70f3c34fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4cd4d5a63dba4a98a8d496e70f3c34fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4cd4d5a63dba4a98a8d496e70f3c34fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:27:24.393589 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant: tempest-VolumesNegativeTest-1699008772 Jul 29 05:27:24.393589 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Id: 4cd4d5a63dba4a98a8d496e70f3c34fe Jul 29 05:27:24.393589 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Name: tempest-VolumesNegativeTest-1699008772 Jul 29 05:27:24.393589 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User: tempest-VolumesNegativeTest-1699008772-project Jul 29 05:27:24.393589 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Id: default Jul 29 05:27:24.393589 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Name: Default Jul 29 05:27:24.393589 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Id: fbd5075bcaa445e9973e82609090f4e1 Jul 29 05:27:24.393589 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Name: tempest-VolumesNegativeTest-1699008772-project Jul 29 05:27:24.393589 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Jul 29 05:27:24.393589 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-387114901", "metadata": {"Type": "work"}}} Jul 29 05:27:24.393589 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: method: Jul 29 05:27:24.393589 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 29 05:27:24.395533 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-387114901', 'metadata': {'Type': 'work'}}}} Jul 29 05:27:24.395533 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:27:24.395533 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:24.395533 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 29 05:27:24.395533 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 29 05:27:24.395533 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 29 05:27:24.395533 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise error Jul 29 05:27:24.395533 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 29 05:27:24.395533 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.395533 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 29 05:27:24.395533 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 29 05:27:24.395533 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.395533 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 29 05:27:24.395533 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi '#$%' Jul 29 05:27:24.395533 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.395533 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:27:24.395533 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.395533 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:24.395533 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:27:24.395533 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:27:24.395533 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:27:24.395533 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:27:24.398486 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 05:27:24.398486 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 05:27:24.398486 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:27:24.398486 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:27:24.398486 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 29 05:27:24.398486 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 29 05:27:24.398486 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 29 05:27:24.398486 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 29 05:27:24.398486 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 29 05:27:24.398486 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 29 05:27:24.398486 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 29 05:27:24.398486 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.398486 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:27:24.398486 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.398486 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:24.398486 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:27:24.398486 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:27:24.398486 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 29 05:27:24.398486 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 29 05:27:24.401375 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 29 05:27:24.401375 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.401375 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-9399675a-5765-48d5-a8bd-2213d064f5d1 tempest-VolumesNegativeTest-1699008772 tempest-VolumesNegativeTest-1699008772-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:27:24.401375 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-9399675a-5765-48d5-a8bd-2213d064f5d1 tempest-VolumesNegativeTest-1699008772 tempest-VolumesNegativeTest-1699008772-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.152727 Jul 29 05:27:24.401375 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 402/847] 10.222.0.49 () {60 vars in 1156 bytes} [Fri Jul 29 05:27:24 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 154 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 29 05:27:24.407908 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-18794817-6061-4c38-9f21-36335726f9a0 tempest-VolumesNegativeTest-1699008772 tempest-VolumesNegativeTest-1699008772-project] Action: 'create', calling method: .version_select at 0x7fa63ac6cc10>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-213921121", "metadata": {"Type": "work"}}} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:27:24.413629 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-18794817-6061-4c38-9f21-36335726f9a0 tempest-VolumesNegativeTest-1699008772 tempest-VolumesNegativeTest-1699008772-project] Request method failure captured: Jul 29 05:27:24.413629 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 29 05:27:24.413629 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept: application/json Jul 29 05:27:24.413629 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept-Encoding: identity Jul 29 05:27:24.413629 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Connection: close Jul 29 05:27:24.413629 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Length: 119 Jul 29 05:27:24.413629 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Type: application/json Jul 29 05:27:24.413629 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Host: 10.222.0.49 Jul 29 05:27:24.413629 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Openstack-System-Scope: None Jul 29 05:27:24.413629 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: User-Agent: python-urllib3/1.26.10 Jul 29 05:27:24.413629 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Auth-Token: gAAAAABi42-8C0Z4PHMhlxEb1xgVGoAeI4tAM0mHXiakEEO62TP4YpOGW3XBoKrnO7PMKXsG8LYXtH36HFZCQseRkahK3xIkvtSX1c2Nwr-7hAJgrpz4wifKvXlW89Lxhp9Dt4tewZwjBObNgL_BDd3m_Jn0kMgSUoLrKLjH6A_Nm0r8Ymo93kU Jul 29 05:27:24.413629 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Id: None Jul 29 05:27:24.413629 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Name: None Jul 29 05:27:24.413629 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Identity-Status: Confirmed Jul 29 05:27:24.413629 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Is-Admin-Project: True Jul 29 05:27:24.413629 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Id: default Jul 29 05:27:24.413629 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Name: Default Jul 29 05:27:24.413629 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Id: 4cd4d5a63dba4a98a8d496e70f3c34fe Jul 29 05:27:24.413629 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Name: tempest-VolumesNegativeTest-1699008772 Jul 29 05:27:24.413629 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Role: member,reader Jul 29 05:27:24.413629 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Roles: member,reader Jul 29 05:27:24.416287 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4cd4d5a63dba4a98a8d496e70f3c34fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4cd4d5a63dba4a98a8d496e70f3c34fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4cd4d5a63dba4a98a8d496e70f3c34fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4cd4d5a63dba4a98a8d496e70f3c34fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:27:24.416287 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant: tempest-VolumesNegativeTest-1699008772 Jul 29 05:27:24.416287 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Id: 4cd4d5a63dba4a98a8d496e70f3c34fe Jul 29 05:27:24.416287 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Name: tempest-VolumesNegativeTest-1699008772 Jul 29 05:27:24.416287 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User: tempest-VolumesNegativeTest-1699008772-project Jul 29 05:27:24.416287 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Id: default Jul 29 05:27:24.416287 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Name: Default Jul 29 05:27:24.416287 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Id: fbd5075bcaa445e9973e82609090f4e1 Jul 29 05:27:24.416287 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Name: tempest-VolumesNegativeTest-1699008772-project Jul 29 05:27:24.416287 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Jul 29 05:27:24.416287 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-213921121", "metadata": {"Type": "work"}}} Jul 29 05:27:24.416287 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: method: Jul 29 05:27:24.416287 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 29 05:27:24.417105 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-213921121', 'metadata': {'Type': 'work'}}}} Jul 29 05:27:24.417105 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:27:24.417105 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:24.417105 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 29 05:27:24.417105 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 29 05:27:24.417105 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 29 05:27:24.417105 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise error Jul 29 05:27:24.417105 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 29 05:27:24.417105 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.417105 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 29 05:27:24.417105 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 29 05:27:24.417105 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.417105 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 29 05:27:24.417105 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi '0' Jul 29 05:27:24.417105 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.417105 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:27:24.417105 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.417105 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:24.417105 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:27:24.417105 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:27:24.417105 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:27:24.417105 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:27:24.418402 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 05:27:24.418402 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 05:27:24.418402 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:27:24.418402 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:27:24.418402 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 29 05:27:24.418402 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 29 05:27:24.418402 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 29 05:27:24.418402 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 29 05:27:24.418402 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 29 05:27:24.418402 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 29 05:27:24.418402 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 29 05:27:24.418402 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.418402 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:27:24.418402 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.418402 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:24.418402 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:27:24.418402 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:27:24.418402 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 29 05:27:24.418402 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 29 05:27:24.421861 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 29 05:27:24.421861 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.421861 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-18794817-6061-4c38-9f21-36335726f9a0 tempest-VolumesNegativeTest-1699008772 tempest-VolumesNegativeTest-1699008772-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:27:24.421861 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-18794817-6061-4c38-9f21-36335726f9a0 tempest-VolumesNegativeTest-1699008772 tempest-VolumesNegativeTest-1699008772-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011531 Jul 29 05:27:24.421861 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 446/848] 10.222.0.49 () {60 vars in 1156 bytes} [Fri Jul 29 05:27:24 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 29 05:27:24.428508 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-64c10f47-72ba-4199-ba47-72986b75af2a tempest-VolumesNegativeTest-1699008772 tempest-VolumesNegativeTest-1699008772-project] Action: 'create', calling method: .version_select at 0x7fa63ab71c10>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2130892876", "metadata": {"Type": "work"}}} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:27:24.433587 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-64c10f47-72ba-4199-ba47-72986b75af2a tempest-VolumesNegativeTest-1699008772 tempest-VolumesNegativeTest-1699008772-project] Request method failure captured: Jul 29 05:27:24.433587 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 29 05:27:24.433587 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept: application/json Jul 29 05:27:24.433587 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept-Encoding: identity Jul 29 05:27:24.433587 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Connection: close Jul 29 05:27:24.433587 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Length: 119 Jul 29 05:27:24.433587 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Type: application/json Jul 29 05:27:24.433587 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Host: 10.222.0.49 Jul 29 05:27:24.433587 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Openstack-System-Scope: None Jul 29 05:27:24.433587 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: User-Agent: python-urllib3/1.26.10 Jul 29 05:27:24.433587 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Auth-Token: gAAAAABi42-8C0Z4PHMhlxEb1xgVGoAeI4tAM0mHXiakEEO62TP4YpOGW3XBoKrnO7PMKXsG8LYXtH36HFZCQseRkahK3xIkvtSX1c2Nwr-7hAJgrpz4wifKvXlW89Lxhp9Dt4tewZwjBObNgL_BDd3m_Jn0kMgSUoLrKLjH6A_Nm0r8Ymo93kU Jul 29 05:27:24.433587 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Id: None Jul 29 05:27:24.433587 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Name: None Jul 29 05:27:24.433587 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Identity-Status: Confirmed Jul 29 05:27:24.433587 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Is-Admin-Project: True Jul 29 05:27:24.433587 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Id: default Jul 29 05:27:24.433587 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Name: Default Jul 29 05:27:24.433587 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Id: 4cd4d5a63dba4a98a8d496e70f3c34fe Jul 29 05:27:24.433587 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Name: tempest-VolumesNegativeTest-1699008772 Jul 29 05:27:24.433587 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Role: member,reader Jul 29 05:27:24.433587 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Roles: member,reader Jul 29 05:27:24.437090 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4cd4d5a63dba4a98a8d496e70f3c34fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4cd4d5a63dba4a98a8d496e70f3c34fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4cd4d5a63dba4a98a8d496e70f3c34fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4cd4d5a63dba4a98a8d496e70f3c34fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:27:24.437090 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant: tempest-VolumesNegativeTest-1699008772 Jul 29 05:27:24.437090 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Id: 4cd4d5a63dba4a98a8d496e70f3c34fe Jul 29 05:27:24.437090 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Name: tempest-VolumesNegativeTest-1699008772 Jul 29 05:27:24.437090 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User: tempest-VolumesNegativeTest-1699008772-project Jul 29 05:27:24.437090 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Id: default Jul 29 05:27:24.437090 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Name: Default Jul 29 05:27:24.437090 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Id: fbd5075bcaa445e9973e82609090f4e1 Jul 29 05:27:24.437090 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Name: tempest-VolumesNegativeTest-1699008772-project Jul 29 05:27:24.437090 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Jul 29 05:27:24.437090 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2130892876", "metadata": {"Type": "work"}}} Jul 29 05:27:24.437090 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: method: Jul 29 05:27:24.437090 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 29 05:27:24.441561 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2130892876', 'metadata': {'Type': 'work'}}}} Jul 29 05:27:24.441561 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:27:24.441561 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:24.441561 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 29 05:27:24.441561 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 29 05:27:24.441561 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 29 05:27:24.441561 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise error Jul 29 05:27:24.441561 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 29 05:27:24.441561 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.441561 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 29 05:27:24.441561 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 29 05:27:24.441561 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.441561 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 29 05:27:24.441561 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi '' Jul 29 05:27:24.441561 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.441561 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:27:24.441561 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.441561 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:24.441561 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:27:24.441561 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:27:24.441561 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:27:24.441561 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:27:24.444271 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 05:27:24.444271 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 05:27:24.444271 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:27:24.444271 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:27:24.444271 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 29 05:27:24.444271 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 29 05:27:24.444271 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 29 05:27:24.444271 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 29 05:27:24.444271 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 29 05:27:24.444271 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 29 05:27:24.444271 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 29 05:27:24.444271 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.444271 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:27:24.444271 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.444271 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:24.444271 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:27:24.444271 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:27:24.444271 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 29 05:27:24.444271 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 29 05:27:24.447413 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 29 05:27:24.447413 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.447413 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-64c10f47-72ba-4199-ba47-72986b75af2a tempest-VolumesNegativeTest-1699008772 tempest-VolumesNegativeTest-1699008772-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:27:24.447413 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-64c10f47-72ba-4199-ba47-72986b75af2a tempest-VolumesNegativeTest-1699008772 tempest-VolumesNegativeTest-1699008772-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012347 Jul 29 05:27:24.447413 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 403/849] 10.222.0.49 () {60 vars in 1156 bytes} [Fri Jul 29 05:27:24 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 29 05:27:24.448050 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-b7c77252-1a76-4b91-821a-ebe870934400 tempest-VolumesNegativeTest-1699008772 tempest-VolumesNegativeTest-1699008772-project] Calling method '.version_select at 0x7fa63ac74820>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:24.482306 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.wsgi [None req-b7c77252-1a76-4b91-821a-ebe870934400 tempest-VolumesNegativeTest-1699008772 tempest-VolumesNegativeTest-1699008772-project] HTTP exception thrown: Volume tempest-invalid-354893677 could not be found. Jul 29 05:27:24.484464 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-b7c77252-1a76-4b91-821a-ebe870934400 tempest-VolumesNegativeTest-1699008772 tempest-VolumesNegativeTest-1699008772-project] Request method failure captured: Jul 29 05:27:24.484464 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-354893677 HTTP/1.1 Jul 29 05:27:24.484464 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept: application/json Jul 29 05:27:24.484464 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept-Encoding: identity Jul 29 05:27:24.484464 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Connection: close Jul 29 05:27:24.484464 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Length: 0 Jul 29 05:27:24.484464 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Type: application/json Jul 29 05:27:24.484464 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Host: 10.222.0.49 Jul 29 05:27:24.484464 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Openstack-System-Scope: None Jul 29 05:27:24.484464 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: User-Agent: python-urllib3/1.26.10 Jul 29 05:27:24.484464 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Auth-Token: gAAAAABi42-8C0Z4PHMhlxEb1xgVGoAeI4tAM0mHXiakEEO62TP4YpOGW3XBoKrnO7PMKXsG8LYXtH36HFZCQseRkahK3xIkvtSX1c2Nwr-7hAJgrpz4wifKvXlW89Lxhp9Dt4tewZwjBObNgL_BDd3m_Jn0kMgSUoLrKLjH6A_Nm0r8Ymo93kU Jul 29 05:27:24.484464 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Id: None Jul 29 05:27:24.484464 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Name: None Jul 29 05:27:24.484464 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Identity-Status: Confirmed Jul 29 05:27:24.484464 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Is-Admin-Project: True Jul 29 05:27:24.484464 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Id: default Jul 29 05:27:24.484464 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Name: Default Jul 29 05:27:24.484464 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Id: 4cd4d5a63dba4a98a8d496e70f3c34fe Jul 29 05:27:24.484464 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Name: tempest-VolumesNegativeTest-1699008772 Jul 29 05:27:24.484464 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Role: member,reader Jul 29 05:27:24.484464 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Roles: member,reader Jul 29 05:27:24.486877 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4cd4d5a63dba4a98a8d496e70f3c34fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4cd4d5a63dba4a98a8d496e70f3c34fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4cd4d5a63dba4a98a8d496e70f3c34fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4cd4d5a63dba4a98a8d496e70f3c34fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:27:24.486877 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant: tempest-VolumesNegativeTest-1699008772 Jul 29 05:27:24.486877 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Id: 4cd4d5a63dba4a98a8d496e70f3c34fe Jul 29 05:27:24.486877 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Name: tempest-VolumesNegativeTest-1699008772 Jul 29 05:27:24.486877 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User: tempest-VolumesNegativeTest-1699008772-project Jul 29 05:27:24.486877 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Id: default Jul 29 05:27:24.486877 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Name: Default Jul 29 05:27:24.486877 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Id: fbd5075bcaa445e9973e82609090f4e1 Jul 29 05:27:24.486877 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Name: tempest-VolumesNegativeTest-1699008772-project Jul 29 05:27:24.486877 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: method: Jul 29 05:27:24.486877 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: exception: Volume tempest-invalid-354893677 could not be found. Jul 29 05:27:24.486877 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: action_args: {'id': 'tempest-invalid-354893677'} Jul 29 05:27:24.486877 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:27:24.487720 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:24.487720 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 05:27:24.487720 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 05:27:24.487720 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 05:27:24.487720 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 05:27:24.487720 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 05:27:24.487720 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 05:27:24.487720 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 05:27:24.487720 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 05:27:24.487720 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 05:27:24.487720 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 05:27:24.487720 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 05:27:24.487720 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 05:27:24.487720 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 05:27:24.487720 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 05:27:24.487720 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-354893677 could not be found. (HTTP 404) (Request-ID: req-5b54164d-f02a-40e2-8cce-3ea72b156ce7) Jul 29 05:27:24.487720 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.487720 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:27:24.487720 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.488890 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:24.488890 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 29 05:27:24.488890 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 29 05:27:24.488890 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 05:27:24.488890 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 05:27:24.488890 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 05:27:24.488890 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 05:27:24.488890 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 05:27:24.488890 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 05:27:24.488890 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 05:27:24.488890 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 05:27:24.488890 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 05:27:24.488890 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 05:27:24.488890 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 05:27:24.488890 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 05:27:24.488890 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 05:27:24.488890 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 05:27:24.488890 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 05:27:24.488890 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 05:27:24.490027 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 05:27:24.490027 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 05:27:24.490027 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 05:27:24.490027 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 05:27:24.490027 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-354893677 could not be found. Jul 29 05:27:24.490027 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.490027 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:27:24.490027 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.490027 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:24.490027 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:27:24.490027 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:27:24.490027 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:27:24.490027 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:27:24.490027 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 05:27:24.490027 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 05:27:24.490027 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:27:24.490027 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:27:24.490027 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 29 05:27:24.490027 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:27:24.490027 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-354893677 could not be found. Jul 29 05:27:24.491207 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.491207 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:27:24.491207 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.491207 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:24.491207 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:27:24.491207 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:27:24.491207 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:27:24.491207 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:27:24.491207 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-354893677 could not be found. Jul 29 05:27:24.491207 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.491207 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-b7c77252-1a76-4b91-821a-ebe870934400 tempest-VolumesNegativeTest-1699008772 tempest-VolumesNegativeTest-1699008772-project] Returning 404 to user: Volume tempest-invalid-354893677 could not be found. {{(pid=117821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:27:24.491207 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-b7c77252-1a76-4b91-821a-ebe870934400 tempest-VolumesNegativeTest-1699008772 tempest-VolumesNegativeTest-1699008772-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/tempest-invalid-354893677" status: 404 len: 98 microversion: 2.1 time: 0.043886 Jul 29 05:27:24.491207 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 447/850] 10.222.0.49 () {58 vars in 1215 bytes} [Fri Jul 29 05:27:24 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-354893677 => generated 98 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 29 05:27:24.497448 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-e30019f3-a221-4b25-ba4c-fd953db293f2 tempest-VolumesNegativeTest-1699008772 tempest-VolumesNegativeTest-1699008772-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003958 Jul 29 05:27:24.499499 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 404/851] 10.222.0.49 () {58 vars in 1140 bytes} [Fri Jul 29 05:27:24 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 29 05:27:24.508444 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-647c831c-f0ad-4f3c-9ab8-d0f6bd1475cb tempest-VolumesNegativeTest-1699008772 tempest-VolumesNegativeTest-1699008772-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004302 Jul 29 05:27:24.509721 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 448/852] 10.222.0.49 () {58 vars in 1137 bytes} [Fri Jul 29 05:27:24 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 29 05:27:24.522036 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-3e7d4a8c-cf5b-4f4e-8e43-fb70e5e82e12 tempest-VolumesNegativeTest-1699008772 tempest-VolumesNegativeTest-1699008772-project] Calling method '.version_select at 0x7fa63ab22c10>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:24.556254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.wsgi [None req-3e7d4a8c-cf5b-4f4e-8e43-fb70e5e82e12 tempest-VolumesNegativeTest-1699008772 tempest-VolumesNegativeTest-1699008772-project] HTTP exception thrown: Volume 5696ba74-8d00-4d3a-9cde-d0c81d2855d5 could not be found. Jul 29 05:27:24.556254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-3e7d4a8c-cf5b-4f4e-8e43-fb70e5e82e12 tempest-VolumesNegativeTest-1699008772 tempest-VolumesNegativeTest-1699008772-project] Request method failure captured: Jul 29 05:27:24.556254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: request: DELETE /compute/v2.1/os-volumes/5696ba74-8d00-4d3a-9cde-d0c81d2855d5 HTTP/1.1 Jul 29 05:27:24.556254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept: application/json Jul 29 05:27:24.556254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept-Encoding: identity Jul 29 05:27:24.556254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Connection: close Jul 29 05:27:24.556254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Length: 0 Jul 29 05:27:24.556254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Type: application/json Jul 29 05:27:24.556254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Host: 10.222.0.49 Jul 29 05:27:24.556254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Openstack-System-Scope: None Jul 29 05:27:24.556254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: User-Agent: python-urllib3/1.26.10 Jul 29 05:27:24.556254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Auth-Token: gAAAAABi42-8C0Z4PHMhlxEb1xgVGoAeI4tAM0mHXiakEEO62TP4YpOGW3XBoKrnO7PMKXsG8LYXtH36HFZCQseRkahK3xIkvtSX1c2Nwr-7hAJgrpz4wifKvXlW89Lxhp9Dt4tewZwjBObNgL_BDd3m_Jn0kMgSUoLrKLjH6A_Nm0r8Ymo93kU Jul 29 05:27:24.556254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Id: None Jul 29 05:27:24.556254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Name: None Jul 29 05:27:24.556254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Identity-Status: Confirmed Jul 29 05:27:24.556254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Is-Admin-Project: True Jul 29 05:27:24.556254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Id: default Jul 29 05:27:24.556254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Name: Default Jul 29 05:27:24.556254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Id: 4cd4d5a63dba4a98a8d496e70f3c34fe Jul 29 05:27:24.556254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Name: tempest-VolumesNegativeTest-1699008772 Jul 29 05:27:24.556254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Role: member,reader Jul 29 05:27:24.556254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Roles: member,reader Jul 29 05:27:24.558254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4cd4d5a63dba4a98a8d496e70f3c34fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4cd4d5a63dba4a98a8d496e70f3c34fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4cd4d5a63dba4a98a8d496e70f3c34fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4cd4d5a63dba4a98a8d496e70f3c34fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:27:24.558254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant: tempest-VolumesNegativeTest-1699008772 Jul 29 05:27:24.558254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Id: 4cd4d5a63dba4a98a8d496e70f3c34fe Jul 29 05:27:24.558254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Name: tempest-VolumesNegativeTest-1699008772 Jul 29 05:27:24.558254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User: tempest-VolumesNegativeTest-1699008772-project Jul 29 05:27:24.558254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Id: default Jul 29 05:27:24.558254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Name: Default Jul 29 05:27:24.558254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Id: fbd5075bcaa445e9973e82609090f4e1 Jul 29 05:27:24.558254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Name: tempest-VolumesNegativeTest-1699008772-project Jul 29 05:27:24.558254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: method: Jul 29 05:27:24.558254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: exception: Volume 5696ba74-8d00-4d3a-9cde-d0c81d2855d5 could not be found. Jul 29 05:27:24.558254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: action_args: {'id': '5696ba74-8d00-4d3a-9cde-d0c81d2855d5'} Jul 29 05:27:24.558254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:27:24.559036 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:24.559036 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 05:27:24.559036 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 05:27:24.559036 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 05:27:24.559036 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 05:27:24.559036 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 05:27:24.559036 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 05:27:24.559036 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 05:27:24.559036 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 05:27:24.559036 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 05:27:24.559036 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 05:27:24.559036 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 05:27:24.559036 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 05:27:24.559036 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 05:27:24.559036 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 05:27:24.559036 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5696ba74-8d00-4d3a-9cde-d0c81d2855d5 could not be found. (HTTP 404) (Request-ID: req-bb4b261f-59c9-4a15-817d-74d3efaf6a6a) Jul 29 05:27:24.559036 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.559036 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:27:24.559036 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.560264 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:24.560264 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 29 05:27:24.560264 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 29 05:27:24.560264 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 05:27:24.560264 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 05:27:24.560264 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 05:27:24.560264 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 05:27:24.560264 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 05:27:24.560264 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 05:27:24.560264 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 05:27:24.560264 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 05:27:24.560264 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 05:27:24.560264 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 05:27:24.560264 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 05:27:24.560264 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 05:27:24.560264 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 05:27:24.560264 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 05:27:24.560264 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 05:27:24.560264 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 05:27:24.561376 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 05:27:24.561376 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 05:27:24.561376 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 05:27:24.561376 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 05:27:24.561376 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5696ba74-8d00-4d3a-9cde-d0c81d2855d5 could not be found. Jul 29 05:27:24.561376 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.561376 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:27:24.561376 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.561376 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:24.561376 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:27:24.561376 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:27:24.561376 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:27:24.561376 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:27:24.561376 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 05:27:24.561376 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 05:27:24.561376 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:27:24.561376 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:27:24.561376 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 29 05:27:24.561376 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:27:24.562988 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5696ba74-8d00-4d3a-9cde-d0c81d2855d5 could not be found. Jul 29 05:27:24.562988 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.562988 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:27:24.562988 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.562988 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:24.562988 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:27:24.562988 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:27:24.562988 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:27:24.562988 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:27:24.562988 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5696ba74-8d00-4d3a-9cde-d0c81d2855d5 could not be found. Jul 29 05:27:24.562988 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.562988 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-3e7d4a8c-cf5b-4f4e-8e43-fb70e5e82e12 tempest-VolumesNegativeTest-1699008772 tempest-VolumesNegativeTest-1699008772-project] Returning 404 to user: Volume 5696ba74-8d00-4d3a-9cde-d0c81d2855d5 could not be found. {{(pid=117820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:27:24.562988 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-3e7d4a8c-cf5b-4f4e-8e43-fb70e5e82e12 tempest-VolumesNegativeTest-1699008772 tempest-VolumesNegativeTest-1699008772-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/5696ba74-8d00-4d3a-9cde-d0c81d2855d5" status: 404 len: 109 microversion: 2.1 time: 0.039958 Jul 29 05:27:24.562988 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 405/853] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Jul 29 05:27:24 2022] DELETE /compute/v2.1/os-volumes/5696ba74-8d00-4d3a-9cde-d0c81d2855d5 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:27:24.568589 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-371d6849-01f3-4f20-9d42-bd9fb7104424 tempest-VolumesNegativeTest-1699008772 tempest-VolumesNegativeTest-1699008772-project] Calling method '.version_select at 0x7fa63ac265e0>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:24.599742 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.wsgi [None req-371d6849-01f3-4f20-9d42-bd9fb7104424 tempest-VolumesNegativeTest-1699008772 tempest-VolumesNegativeTest-1699008772-project] HTTP exception thrown: Volume 7765a968-96db-4ed2-a113-4c7c8f7e1d7c could not be found. Jul 29 05:27:24.601750 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-371d6849-01f3-4f20-9d42-bd9fb7104424 tempest-VolumesNegativeTest-1699008772 tempest-VolumesNegativeTest-1699008772-project] Request method failure captured: Jul 29 05:27:24.601750 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: request: GET /compute/v2.1/os-volumes/7765a968-96db-4ed2-a113-4c7c8f7e1d7c HTTP/1.1 Jul 29 05:27:24.601750 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept: application/json Jul 29 05:27:24.601750 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept-Encoding: identity Jul 29 05:27:24.601750 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Connection: close Jul 29 05:27:24.601750 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Length: 0 Jul 29 05:27:24.601750 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Type: application/json Jul 29 05:27:24.601750 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Host: 10.222.0.49 Jul 29 05:27:24.601750 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Openstack-System-Scope: None Jul 29 05:27:24.601750 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: User-Agent: python-urllib3/1.26.10 Jul 29 05:27:24.601750 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Auth-Token: gAAAAABi42-8C0Z4PHMhlxEb1xgVGoAeI4tAM0mHXiakEEO62TP4YpOGW3XBoKrnO7PMKXsG8LYXtH36HFZCQseRkahK3xIkvtSX1c2Nwr-7hAJgrpz4wifKvXlW89Lxhp9Dt4tewZwjBObNgL_BDd3m_Jn0kMgSUoLrKLjH6A_Nm0r8Ymo93kU Jul 29 05:27:24.601750 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Id: None Jul 29 05:27:24.601750 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Name: None Jul 29 05:27:24.601750 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Identity-Status: Confirmed Jul 29 05:27:24.601750 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Is-Admin-Project: True Jul 29 05:27:24.601750 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Id: default Jul 29 05:27:24.601750 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Name: Default Jul 29 05:27:24.601750 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Id: 4cd4d5a63dba4a98a8d496e70f3c34fe Jul 29 05:27:24.601750 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Name: tempest-VolumesNegativeTest-1699008772 Jul 29 05:27:24.601750 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Role: member,reader Jul 29 05:27:24.601750 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Roles: member,reader Jul 29 05:27:24.603327 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4cd4d5a63dba4a98a8d496e70f3c34fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4cd4d5a63dba4a98a8d496e70f3c34fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4cd4d5a63dba4a98a8d496e70f3c34fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4cd4d5a63dba4a98a8d496e70f3c34fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:27:24.603327 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant: tempest-VolumesNegativeTest-1699008772 Jul 29 05:27:24.603327 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Id: 4cd4d5a63dba4a98a8d496e70f3c34fe Jul 29 05:27:24.603327 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Name: tempest-VolumesNegativeTest-1699008772 Jul 29 05:27:24.603327 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User: tempest-VolumesNegativeTest-1699008772-project Jul 29 05:27:24.603327 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Id: default Jul 29 05:27:24.603327 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Name: Default Jul 29 05:27:24.603327 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Id: fbd5075bcaa445e9973e82609090f4e1 Jul 29 05:27:24.603327 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Name: tempest-VolumesNegativeTest-1699008772-project Jul 29 05:27:24.603327 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: method: Jul 29 05:27:24.603327 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: exception: Volume 7765a968-96db-4ed2-a113-4c7c8f7e1d7c could not be found. Jul 29 05:27:24.603327 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: action_args: {'id': '7765a968-96db-4ed2-a113-4c7c8f7e1d7c'} Jul 29 05:27:24.603327 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:27:24.604324 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:24.604324 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 05:27:24.604324 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 05:27:24.604324 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 05:27:24.604324 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 05:27:24.604324 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 05:27:24.604324 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 05:27:24.604324 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 05:27:24.604324 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 05:27:24.604324 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 05:27:24.604324 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 05:27:24.604324 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 05:27:24.604324 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 05:27:24.604324 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 05:27:24.604324 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 05:27:24.604324 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7765a968-96db-4ed2-a113-4c7c8f7e1d7c could not be found. (HTTP 404) (Request-ID: req-be747ac9-16bb-4e8f-8bdc-1aad5a8cba19) Jul 29 05:27:24.604324 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.604324 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:27:24.604324 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.605470 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:24.605470 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 29 05:27:24.605470 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 29 05:27:24.605470 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 05:27:24.605470 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 05:27:24.605470 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 05:27:24.605470 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 05:27:24.605470 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 05:27:24.605470 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 05:27:24.605470 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 05:27:24.605470 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 05:27:24.605470 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 05:27:24.605470 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 05:27:24.605470 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 05:27:24.605470 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 05:27:24.605470 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 05:27:24.605470 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 05:27:24.605470 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 05:27:24.605470 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 05:27:24.606553 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 05:27:24.606553 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 05:27:24.606553 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 05:27:24.606553 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 05:27:24.606553 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7765a968-96db-4ed2-a113-4c7c8f7e1d7c could not be found. Jul 29 05:27:24.606553 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.606553 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:27:24.606553 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.606553 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:24.606553 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:27:24.606553 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:27:24.606553 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:27:24.606553 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:27:24.606553 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 05:27:24.606553 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 05:27:24.606553 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:27:24.606553 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:27:24.606553 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 29 05:27:24.606553 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:27:24.607695 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7765a968-96db-4ed2-a113-4c7c8f7e1d7c could not be found. Jul 29 05:27:24.607695 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.607695 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:27:24.607695 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.607695 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:27:24.607695 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:27:24.607695 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:27:24.607695 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:27:24.607695 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:27:24.607695 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7765a968-96db-4ed2-a113-4c7c8f7e1d7c could not be found. Jul 29 05:27:24.607695 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:27:24.607695 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-371d6849-01f3-4f20-9d42-bd9fb7104424 tempest-VolumesNegativeTest-1699008772 tempest-VolumesNegativeTest-1699008772-project] Returning 404 to user: Volume 7765a968-96db-4ed2-a113-4c7c8f7e1d7c could not be found. {{(pid=117821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:27:24.607695 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-371d6849-01f3-4f20-9d42-bd9fb7104424 tempest-VolumesNegativeTest-1699008772 tempest-VolumesNegativeTest-1699008772-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/7765a968-96db-4ed2-a113-4c7c8f7e1d7c" status: 404 len: 109 microversion: 2.1 time: 0.038535 Jul 29 05:27:24.607695 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 449/854] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Jul 29 05:27:24 2022] GET /compute/v2.1/os-volumes/7765a968-96db-4ed2-a113-4c7c8f7e1d7c => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:27:24.759295 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-79a6d1cd-554c-4413-9df7-0d00993a1e25 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:24.760603 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-79a6d1cd-554c-4413-9df7-0d00993a1e25 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:24.769349 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-79a6d1cd-554c-4413-9df7-0d00993a1e25 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:24.769826 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-79a6d1cd-554c-4413-9df7-0d00993a1e25 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:24.770713 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-79a6d1cd-554c-4413-9df7-0d00993a1e25 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:24.771391 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-79a6d1cd-554c-4413-9df7-0d00993a1e25 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:25.032099 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-79a6d1cd-554c-4413-9df7-0d00993a1e25 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:25.041948 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-79a6d1cd-554c-4413-9df7-0d00993a1e25 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:25.043622 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-79a6d1cd-554c-4413-9df7-0d00993a1e25 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:25.044912 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-79a6d1cd-554c-4413-9df7-0d00993a1e25 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1743 microversion: 2.20 time: 0.294653 Jul 29 05:27:25.045565 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 406/855] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:24 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1743 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:27:26.075532 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-8c953162-7478-4eb5-8955-074634cf0c1e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:26.077266 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-8c953162-7478-4eb5-8955-074634cf0c1e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:26.089779 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8c953162-7478-4eb5-8955-074634cf0c1e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:26.090447 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8c953162-7478-4eb5-8955-074634cf0c1e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:26.092076 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8c953162-7478-4eb5-8955-074634cf0c1e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:26.092932 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8c953162-7478-4eb5-8955-074634cf0c1e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:26.121832 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-f72fe42d-2d9f-4e38-9073-b9ed58cfb840 req-b93ea712-8838-41c2-8bd3-f45368fff102 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8e59cc2-032c-497f-867c-2d5663a4da21", "tag": "6d8585cd-d0d9-4ae4-9146-299c453184a4"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:27:26.147700 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-f72fe42d-2d9f-4e38-9073-b9ed58cfb840 req-b93ea712-8838-41c2-8bd3-f45368fff102 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:26.149566 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-f72fe42d-2d9f-4e38-9073-b9ed58cfb840 req-b93ea712-8838-41c2-8bd3-f45368fff102 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:26.183757 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-f72fe42d-2d9f-4e38-9073-b9ed58cfb840 req-b93ea712-8838-41c2-8bd3-f45368fff102 service nova] Creating event network-changed:6d8585cd-d0d9-4ae4-9146-299c453184a4 for instance a8e59cc2-032c-497f-867c-2d5663a4da21 on hv-cinder-85127 Jul 29 05:27:26.194318 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-f72fe42d-2d9f-4e38-9073-b9ed58cfb840 req-b93ea712-8838-41c2-8bd3-f45368fff102 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079834 Jul 29 05:27:26.200018 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 407/856] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:27:26.346869 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-8c953162-7478-4eb5-8955-074634cf0c1e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:26.356357 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-8c953162-7478-4eb5-8955-074634cf0c1e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:26.362247 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-8c953162-7478-4eb5-8955-074634cf0c1e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:26.365059 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-8c953162-7478-4eb5-8955-074634cf0c1e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1743 microversion: 2.20 time: 0.299209 Jul 29 05:27:26.367311 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 450/857] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:26 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1743 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:27:27.128690 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-d585b1d9-b82c-49d5-ac39-c24805f80ad9 req-a789e806-07bf-4706-9119-44ed34360404 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e3305fc-3d92-4d3f-afb8-c25395280792", "name": "network-vif-plugged", "status": "completed", "tag": "6f412c06-c9c0-4423-b60d-0b7fa2c32b6f"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:27:27.147689 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-d585b1d9-b82c-49d5-ac39-c24805f80ad9 req-a789e806-07bf-4706-9119-44ed34360404 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:27.148847 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-d585b1d9-b82c-49d5-ac39-c24805f80ad9 req-a789e806-07bf-4706-9119-44ed34360404 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:27.178151 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-d585b1d9-b82c-49d5-ac39-c24805f80ad9 req-a789e806-07bf-4706-9119-44ed34360404 service nova] Creating event network-vif-plugged:6f412c06-c9c0-4423-b60d-0b7fa2c32b6f for instance 1e3305fc-3d92-4d3f-afb8-c25395280792 on hv-cinder-85127 Jul 29 05:27:27.190520 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-d585b1d9-b82c-49d5-ac39-c24805f80ad9 req-a789e806-07bf-4706-9119-44ed34360404 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064945 Jul 29 05:27:27.192724 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 408/858] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:27:27.398211 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-1d68572a-29d0-42bd-abec-9c23c440ff0d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:27.399014 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-1d68572a-29d0-42bd-abec-9c23c440ff0d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:27.420025 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1d68572a-29d0-42bd-abec-9c23c440ff0d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:27.420790 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1d68572a-29d0-42bd-abec-9c23c440ff0d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:27.435850 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1d68572a-29d0-42bd-abec-9c23c440ff0d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:27.436704 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1d68572a-29d0-42bd-abec-9c23c440ff0d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:27.875556 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-1d68572a-29d0-42bd-abec-9c23c440ff0d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:27.896654 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-1d68572a-29d0-42bd-abec-9c23c440ff0d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:27.903055 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-1d68572a-29d0-42bd-abec-9c23c440ff0d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:27.909667 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-1d68572a-29d0-42bd-abec-9c23c440ff0d tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1738 microversion: 2.20 time: 0.518969 Jul 29 05:27:27.911552 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 451/859] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:27 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1738 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:27:28.346747 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-c84d0dc0-b543-4b63-9a39-27fd223492b8 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-588483382"}} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:27:28.348754 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-c84d0dc0-b543-4b63-9a39-27fd223492b8 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:28.357085 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c84d0dc0-b543-4b63-9a39-27fd223492b8 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:28.357738 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c84d0dc0-b543-4b63-9a39-27fd223492b8 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:28.358894 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c84d0dc0-b543-4b63-9a39-27fd223492b8 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:28.359561 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c84d0dc0-b543-4b63-9a39-27fd223492b8 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:28.651811 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.network.security_group_api [None req-c84d0dc0-b543-4b63-9a39-27fd223492b8 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Adding security group e1e82250-30d0-4c5a-bdb8-bd9b19a7fcd6 to port 6d8585cd-d0d9-4ae4-9146-299c453184a4 Jul 29 05:27:28.940403 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-20d7ff1a-6c52-412b-8517-60c5e6e45315 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:28.941234 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-20d7ff1a-6c52-412b-8517-60c5e6e45315 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:28.957941 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-20d7ff1a-6c52-412b-8517-60c5e6e45315 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:28.960079 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-20d7ff1a-6c52-412b-8517-60c5e6e45315 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:28.962027 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-20d7ff1a-6c52-412b-8517-60c5e6e45315 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:28.962842 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-20d7ff1a-6c52-412b-8517-60c5e6e45315 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:29.247128 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-c84d0dc0-b543-4b63-9a39-27fd223492b8 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "POST /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/action" status: 202 len: 0 microversion: 2.1 time: 0.920558 Jul 29 05:27:29.247777 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 409/860] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Jul 29 05:27:28 2022] POST /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/action => generated 0 bytes in 922 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 05:27:29.256673 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-8f7f0401-4c34-4bd0-adce-3e7c72be4978 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:29.257560 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-8f7f0401-4c34-4bd0-adce-3e7c72be4978 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:29.274997 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8f7f0401-4c34-4bd0-adce-3e7c72be4978 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:29.278494 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8f7f0401-4c34-4bd0-adce-3e7c72be4978 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:29.279671 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8f7f0401-4c34-4bd0-adce-3e7c72be4978 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:29.282543 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8f7f0401-4c34-4bd0-adce-3e7c72be4978 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:29.399032 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-20d7ff1a-6c52-412b-8517-60c5e6e45315 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:29.421067 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-20d7ff1a-6c52-412b-8517-60c5e6e45315 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:29.427156 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-20d7ff1a-6c52-412b-8517-60c5e6e45315 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:29.431115 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-20d7ff1a-6c52-412b-8517-60c5e6e45315 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1738 microversion: 2.20 time: 0.498138 Jul 29 05:27:29.432439 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 452/861] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:28 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1738 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:27:29.456153 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-01b59c0c-b011-4354-b8d8-1fccea523f86 req-0a578581-ea2f-4687-b214-93d08fecbda4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8e59cc2-032c-497f-867c-2d5663a4da21", "tag": "6d8585cd-d0d9-4ae4-9146-299c453184a4"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:27:29.468998 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-01b59c0c-b011-4354-b8d8-1fccea523f86 req-0a578581-ea2f-4687-b214-93d08fecbda4 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:29.471624 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-01b59c0c-b011-4354-b8d8-1fccea523f86 req-0a578581-ea2f-4687-b214-93d08fecbda4 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:29.489728 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-01b59c0c-b011-4354-b8d8-1fccea523f86 req-0a578581-ea2f-4687-b214-93d08fecbda4 service nova] Creating event network-changed:6d8585cd-d0d9-4ae4-9146-299c453184a4 for instance a8e59cc2-032c-497f-867c-2d5663a4da21 on hv-cinder-85127 Jul 29 05:27:29.497241 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-01b59c0c-b011-4354-b8d8-1fccea523f86 req-0a578581-ea2f-4687-b214-93d08fecbda4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060892 Jul 29 05:27:29.498170 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 453/862] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:27:29.631080 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-8f7f0401-4c34-4bd0-adce-3e7c72be4978 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:29.650626 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-8f7f0401-4c34-4bd0-adce-3e7c72be4978 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1758 microversion: 2.1 time: 0.394410 Jul 29 05:27:29.664543 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 410/863] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:29 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1758 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:27:29.915680 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-30857f01-1eea-465c-82d7-c84018c31d75 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:29.918200 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-30857f01-1eea-465c-82d7-c84018c31d75 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:29.936896 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-30857f01-1eea-465c-82d7-c84018c31d75 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:29.938755 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-30857f01-1eea-465c-82d7-c84018c31d75 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:29.941925 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-30857f01-1eea-465c-82d7-c84018c31d75 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:29.943177 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-30857f01-1eea-465c-82d7-c84018c31d75 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:29.994440 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-30857f01-1eea-465c-82d7-c84018c31d75 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083952 Jul 29 05:27:29.995865 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 454/864] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:27:29 2022] GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:27:30.023428 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-953d71f7-f8e2-4054-8746-93f62d701ca5 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:30.024701 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-953d71f7-f8e2-4054-8746-93f62d701ca5 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:30.037043 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-953d71f7-f8e2-4054-8746-93f62d701ca5 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:30.037871 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-953d71f7-f8e2-4054-8746-93f62d701ca5 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:30.038980 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-953d71f7-f8e2-4054-8746-93f62d701ca5 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:30.039616 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-953d71f7-f8e2-4054-8746-93f62d701ca5 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:30.086062 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-953d71f7-f8e2-4054-8746-93f62d701ca5 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9/os-volume_attachments/3b5c78d1-fe5e-40e3-8a78-dd42bec09d9f" status: 200 len: 194 microversion: 2.1 time: 0.077933 Jul 29 05:27:30.087570 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 411/865] 10.222.0.49 () {58 vars in 1413 bytes} [Fri Jul 29 05:27:30 2022] GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9/os-volume_attachments/3b5c78d1-fe5e-40e3-8a78-dd42bec09d9f => generated 194 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:27:30.460110 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-036226d7-05b7-47ec-990f-30fc072d7ab2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:30.460855 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-036226d7-05b7-47ec-990f-30fc072d7ab2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:30.476241 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-036226d7-05b7-47ec-990f-30fc072d7ab2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:30.477318 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-036226d7-05b7-47ec-990f-30fc072d7ab2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:30.478133 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-036226d7-05b7-47ec-990f-30fc072d7ab2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:30.478572 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-036226d7-05b7-47ec-990f-30fc072d7ab2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:30.853338 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-036226d7-05b7-47ec-990f-30fc072d7ab2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:30.871672 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-036226d7-05b7-47ec-990f-30fc072d7ab2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:30.879960 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-036226d7-05b7-47ec-990f-30fc072d7ab2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:30.881856 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-036226d7-05b7-47ec-990f-30fc072d7ab2 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1738 microversion: 2.20 time: 0.427110 Jul 29 05:27:30.883202 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 455/866] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:30 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1738 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:27:31.801887 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-f4bf277b-f809-4f48-9661-01ace3998e4c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83c4015c-57cc-4a41-a30a-3bbe68459a06"}} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:27:31.804960 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-f4bf277b-f809-4f48-9661-01ace3998e4c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:31.829646 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f4bf277b-f809-4f48-9661-01ace3998e4c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:31.830759 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f4bf277b-f809-4f48-9661-01ace3998e4c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:31.832874 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f4bf277b-f809-4f48-9661-01ace3998e4c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:31.833718 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f4bf277b-f809-4f48-9661-01ace3998e4c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:31.909771 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-acf11538-1d72-4192-8a83-0b3af2ff6b15 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:31.911073 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-acf11538-1d72-4192-8a83-0b3af2ff6b15 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:31.925710 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-acf11538-1d72-4192-8a83-0b3af2ff6b15 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:31.926140 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-acf11538-1d72-4192-8a83-0b3af2ff6b15 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:31.931437 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-acf11538-1d72-4192-8a83-0b3af2ff6b15 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:31.932132 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-acf11538-1d72-4192-8a83-0b3af2ff6b15 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:32.242739 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:27:32.275273 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-acf11538-1d72-4192-8a83-0b3af2ff6b15 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:32.299389 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-acf11538-1d72-4192-8a83-0b3af2ff6b15 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:32.302307 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-acf11538-1d72-4192-8a83-0b3af2ff6b15 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:32.305426 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-acf11538-1d72-4192-8a83-0b3af2ff6b15 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1738 microversion: 2.20 time: 0.399117 Jul 29 05:27:32.306450 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 456/867] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:31 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1738 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:27:32.573989 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-f4bf277b-f809-4f48-9661-01ace3998e4c tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "POST /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.776319 Jul 29 05:27:32.575267 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 412/868] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Jul 29 05:27:31 2022] POST /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9/os-volume_attachments => generated 194 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:27:33.334977 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-da1410cc-7462-4243-8ee9-7df6d14fc5f3 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:33.340451 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-da1410cc-7462-4243-8ee9-7df6d14fc5f3 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:33.366455 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_api:SELECT=64 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:27:33.379710 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-da1410cc-7462-4243-8ee9-7df6d14fc5f3 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:33.381160 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-da1410cc-7462-4243-8ee9-7df6d14fc5f3 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:33.382577 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-da1410cc-7462-4243-8ee9-7df6d14fc5f3 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:33.383380 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-da1410cc-7462-4243-8ee9-7df6d14fc5f3 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:33.662796 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-da1410cc-7462-4243-8ee9-7df6d14fc5f3 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:33.680847 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-da1410cc-7462-4243-8ee9-7df6d14fc5f3 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:33.683793 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-da1410cc-7462-4243-8ee9-7df6d14fc5f3 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:33.686368 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-da1410cc-7462-4243-8ee9-7df6d14fc5f3 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1738 microversion: 2.20 time: 0.360297 Jul 29 05:27:33.687594 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 457/869] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:33 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1738 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:27:34.725225 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-696e4b3b-7937-4606-a8e2-025f0ccf85f1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:34.727995 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-696e4b3b-7937-4606-a8e2-025f0ccf85f1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:34.746279 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-696e4b3b-7937-4606-a8e2-025f0ccf85f1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:34.747527 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-696e4b3b-7937-4606-a8e2-025f0ccf85f1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:34.749692 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-696e4b3b-7937-4606-a8e2-025f0ccf85f1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:34.752145 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-696e4b3b-7937-4606-a8e2-025f0ccf85f1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:35.103756 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-696e4b3b-7937-4606-a8e2-025f0ccf85f1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:35.120896 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-696e4b3b-7937-4606-a8e2-025f0ccf85f1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:35.124730 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-696e4b3b-7937-4606-a8e2-025f0ccf85f1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:35.126732 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-696e4b3b-7937-4606-a8e2-025f0ccf85f1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1738 microversion: 2.20 time: 0.416097 Jul 29 05:27:35.147934 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 413/870] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:34 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1738 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:27:36.168713 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-69230777-f707-49b9-a9b5-3f8f66637ef9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:36.169654 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-69230777-f707-49b9-a9b5-3f8f66637ef9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:36.185545 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-69230777-f707-49b9-a9b5-3f8f66637ef9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:36.186230 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-69230777-f707-49b9-a9b5-3f8f66637ef9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:36.187091 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-69230777-f707-49b9-a9b5-3f8f66637ef9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:36.188555 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-69230777-f707-49b9-a9b5-3f8f66637ef9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:36.443038 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-69230777-f707-49b9-a9b5-3f8f66637ef9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:36.464670 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-69230777-f707-49b9-a9b5-3f8f66637ef9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:36.468354 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-69230777-f707-49b9-a9b5-3f8f66637ef9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:36.470948 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-69230777-f707-49b9-a9b5-3f8f66637ef9 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1738 microversion: 2.20 time: 0.306978 Jul 29 05:27:36.472548 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 458/871] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:36 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1738 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:27:37.502808 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-20800bd4-ef4d-43ff-a2a8-db3f64e84879 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:37.505444 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-20800bd4-ef4d-43ff-a2a8-db3f64e84879 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:37.517334 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-20800bd4-ef4d-43ff-a2a8-db3f64e84879 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:37.518679 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-20800bd4-ef4d-43ff-a2a8-db3f64e84879 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:37.520484 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-20800bd4-ef4d-43ff-a2a8-db3f64e84879 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:37.521501 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-20800bd4-ef4d-43ff-a2a8-db3f64e84879 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:37.728580 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-20800bd4-ef4d-43ff-a2a8-db3f64e84879 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:37.740822 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-20800bd4-ef4d-43ff-a2a8-db3f64e84879 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:37.742497 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-20800bd4-ef4d-43ff-a2a8-db3f64e84879 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:37.743769 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-20800bd4-ef4d-43ff-a2a8-db3f64e84879 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1738 microversion: 2.20 time: 0.248405 Jul 29 05:27:37.744537 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 414/872] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:37 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1738 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:27:38.770766 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-1356522d-a409-489a-bec3-e1967c6921e7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:38.772253 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-1356522d-a409-489a-bec3-e1967c6921e7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:38.779936 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1356522d-a409-489a-bec3-e1967c6921e7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:38.780390 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1356522d-a409-489a-bec3-e1967c6921e7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:38.782091 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1356522d-a409-489a-bec3-e1967c6921e7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:38.782567 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1356522d-a409-489a-bec3-e1967c6921e7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:39.005676 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-1356522d-a409-489a-bec3-e1967c6921e7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:39.022151 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-1356522d-a409-489a-bec3-e1967c6921e7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:39.025032 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-1356522d-a409-489a-bec3-e1967c6921e7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:39.027376 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-1356522d-a409-489a-bec3-e1967c6921e7 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1738 microversion: 2.20 time: 0.261071 Jul 29 05:27:39.046655 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 459/873] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:38 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1738 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:27:40.051673 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-b9e7d647-3d2b-4ffb-852e-8bdf016c89f1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:40.052462 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-b9e7d647-3d2b-4ffb-852e-8bdf016c89f1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:40.054829 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_api:SELECT=48 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:27:40.060577 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b9e7d647-3d2b-4ffb-852e-8bdf016c89f1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:40.061035 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b9e7d647-3d2b-4ffb-852e-8bdf016c89f1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:40.061851 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b9e7d647-3d2b-4ffb-852e-8bdf016c89f1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:40.062799 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b9e7d647-3d2b-4ffb-852e-8bdf016c89f1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:40.195581 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-b9e7d647-3d2b-4ffb-852e-8bdf016c89f1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:40.204458 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-b9e7d647-3d2b-4ffb-852e-8bdf016c89f1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:40.205968 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-b9e7d647-3d2b-4ffb-852e-8bdf016c89f1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:40.207135 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-b9e7d647-3d2b-4ffb-852e-8bdf016c89f1 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1738 microversion: 2.20 time: 0.159580 Jul 29 05:27:40.207722 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 415/874] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:40 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:27:40.491123 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-52c65a7f-ee22-412a-8d27-847e902578d3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:40.493492 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-52c65a7f-ee22-412a-8d27-847e902578d3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:40.503055 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-52c65a7f-ee22-412a-8d27-847e902578d3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:40.503569 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-52c65a7f-ee22-412a-8d27-847e902578d3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:40.504367 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-52c65a7f-ee22-412a-8d27-847e902578d3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:40.504807 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-52c65a7f-ee22-412a-8d27-847e902578d3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:40.537728 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-52c65a7f-ee22-412a-8d27-847e902578d3 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050619 Jul 29 05:27:40.538383 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 460/875] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:27:40 2022] GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:27:40.691899 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-6ecfb279-0132-4675-b7f2-2e201f0eaed8 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:40.692405 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-6ecfb279-0132-4675-b7f2-2e201f0eaed8 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:40.699270 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6ecfb279-0132-4675-b7f2-2e201f0eaed8 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:40.699766 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6ecfb279-0132-4675-b7f2-2e201f0eaed8 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:40.700594 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6ecfb279-0132-4675-b7f2-2e201f0eaed8 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:40.701044 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6ecfb279-0132-4675-b7f2-2e201f0eaed8 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:40.736762 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-6ecfb279-0132-4675-b7f2-2e201f0eaed8 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9/os-volume_attachments/3b5c78d1-fe5e-40e3-8a78-dd42bec09d9f" status: 200 len: 194 microversion: 2.1 time: 0.051528 Jul 29 05:27:40.737381 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 416/876] 10.222.0.49 () {58 vars in 1413 bytes} [Fri Jul 29 05:27:40 2022] GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9/os-volume_attachments/3b5c78d1-fe5e-40e3-8a78-dd42bec09d9f => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:27:40.750141 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-f25e3b74-5f50-4254-b490-47cd7bdd2179 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:40.750678 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-f25e3b74-5f50-4254-b490-47cd7bdd2179 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:40.757732 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f25e3b74-5f50-4254-b490-47cd7bdd2179 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:40.758422 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f25e3b74-5f50-4254-b490-47cd7bdd2179 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:40.759231 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f25e3b74-5f50-4254-b490-47cd7bdd2179 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:40.759946 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f25e3b74-5f50-4254-b490-47cd7bdd2179 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:40.776643 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:27:40.855745 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.objects.instance [None req-f25e3b74-5f50-4254-b490-47cd7bdd2179 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lazy-loading 'services' on Instance uuid 62613145-ee65-4472-a5f6-23a6d76ea1b9 {{(pid=117821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:27:40.956195 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-f25e3b74-5f50-4254-b490-47cd7bdd2179 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "DELETE /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9/os-volume_attachments/3b5c78d1-fe5e-40e3-8a78-dd42bec09d9f" status: 202 len: 0 microversion: 2.1 time: 0.209802 Jul 29 05:27:40.957675 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 461/877] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Jul 29 05:27:40 2022] DELETE /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9/os-volume_attachments/3b5c78d1-fe5e-40e3-8a78-dd42bec09d9f => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 05:27:41.230262 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-83e04d5f-6a7b-417a-b4fe-154ebcb98985 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:41.230870 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-83e04d5f-6a7b-417a-b4fe-154ebcb98985 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:41.238340 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-83e04d5f-6a7b-417a-b4fe-154ebcb98985 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:41.238792 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-83e04d5f-6a7b-417a-b4fe-154ebcb98985 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:41.242150 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-83e04d5f-6a7b-417a-b4fe-154ebcb98985 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:41.244274 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-83e04d5f-6a7b-417a-b4fe-154ebcb98985 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:41.398612 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-83e04d5f-6a7b-417a-b4fe-154ebcb98985 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:41.408205 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-83e04d5f-6a7b-417a-b4fe-154ebcb98985 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:41.409995 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-83e04d5f-6a7b-417a-b4fe-154ebcb98985 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:41.411172 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-83e04d5f-6a7b-417a-b4fe-154ebcb98985 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1720 microversion: 2.20 time: 0.185077 Jul 29 05:27:41.411769 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 417/878] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:41 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1720 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:27:42.435696 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-51917ee2-de42-4c5e-8bf8-03038ab8fcc8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:42.436394 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-51917ee2-de42-4c5e-8bf8-03038ab8fcc8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:42.444180 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-51917ee2-de42-4c5e-8bf8-03038ab8fcc8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:42.444724 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-51917ee2-de42-4c5e-8bf8-03038ab8fcc8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:42.445487 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-51917ee2-de42-4c5e-8bf8-03038ab8fcc8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:42.446001 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-51917ee2-de42-4c5e-8bf8-03038ab8fcc8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:42.583121 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-51917ee2-de42-4c5e-8bf8-03038ab8fcc8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:42.591232 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-51917ee2-de42-4c5e-8bf8-03038ab8fcc8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:42.592776 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-51917ee2-de42-4c5e-8bf8-03038ab8fcc8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:42.594541 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-51917ee2-de42-4c5e-8bf8-03038ab8fcc8 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1720 microversion: 2.20 time: 0.163712 Jul 29 05:27:42.595113 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 462/879] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:42 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:27:42.802050 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-74a1625e-3153-4206-a147-c7742f10c4a7 req-397bec0a-e6bd-4d35-9956-fe9fb8805425 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e3305fc-3d92-4d3f-afb8-c25395280792", "name": "network-vif-unplugged", "status": "completed", "tag": "6f412c06-c9c0-4423-b60d-0b7fa2c32b6f"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:27:42.813413 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-74a1625e-3153-4206-a147-c7742f10c4a7 req-397bec0a-e6bd-4d35-9956-fe9fb8805425 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:42.814853 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-74a1625e-3153-4206-a147-c7742f10c4a7 req-397bec0a-e6bd-4d35-9956-fe9fb8805425 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:42.826120 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-74a1625e-3153-4206-a147-c7742f10c4a7 req-397bec0a-e6bd-4d35-9956-fe9fb8805425 service nova] Creating event network-vif-unplugged:6f412c06-c9c0-4423-b60d-0b7fa2c32b6f for instance 1e3305fc-3d92-4d3f-afb8-c25395280792 on hv-cinder-85127 Jul 29 05:27:42.831896 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-74a1625e-3153-4206-a147-c7742f10c4a7 req-397bec0a-e6bd-4d35-9956-fe9fb8805425 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033438 Jul 29 05:27:42.832496 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 418/880] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:27:43.618791 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-9685eed1-0f91-4a7d-a581-5521a3adc5db tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:43.619541 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-9685eed1-0f91-4a7d-a581-5521a3adc5db tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:43.626554 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9685eed1-0f91-4a7d-a581-5521a3adc5db tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:43.627095 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9685eed1-0f91-4a7d-a581-5521a3adc5db tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:43.628120 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9685eed1-0f91-4a7d-a581-5521a3adc5db tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:43.628629 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9685eed1-0f91-4a7d-a581-5521a3adc5db tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:43.806311 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-9685eed1-0f91-4a7d-a581-5521a3adc5db tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:43.827274 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-9685eed1-0f91-4a7d-a581-5521a3adc5db tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:43.831484 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-9685eed1-0f91-4a7d-a581-5521a3adc5db tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:43.833887 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-9685eed1-0f91-4a7d-a581-5521a3adc5db tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1723 microversion: 2.20 time: 0.218908 Jul 29 05:27:43.835018 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 463/881] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:43 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:27:43.873874 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-c4814767-3be6-48f8-a56a-7a860fe523f4 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ade6dea-1b44-46d0-9f83-ce5db1b1a45c"}} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:27:43.878403 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-c4814767-3be6-48f8-a56a-7a860fe523f4 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:43.886974 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c4814767-3be6-48f8-a56a-7a860fe523f4 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:43.887460 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c4814767-3be6-48f8-a56a-7a860fe523f4 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:43.888358 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c4814767-3be6-48f8-a56a-7a860fe523f4 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:43.888801 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c4814767-3be6-48f8-a56a-7a860fe523f4 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:44.244828 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-67545f8a-1d68-407d-b00a-ad82abdf4862 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:44.245575 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-67545f8a-1d68-407d-b00a-ad82abdf4862 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:44.255649 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-67545f8a-1d68-407d-b00a-ad82abdf4862 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:44.256107 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-67545f8a-1d68-407d-b00a-ad82abdf4862 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:44.257108 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-67545f8a-1d68-407d-b00a-ad82abdf4862 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:44.257830 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-67545f8a-1d68-407d-b00a-ad82abdf4862 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:44.300981 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-c4814767-3be6-48f8-a56a-7a860fe523f4 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "POST /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.437031 Jul 29 05:27:44.302511 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 419/882] 10.222.0.49 () {62 vars in 1364 bytes} [Fri Jul 29 05:27:43 2022] POST /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792/os-volume_attachments => generated 188 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 05:27:44.310772 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-67545f8a-1d68-407d-b00a-ad82abdf4862 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9/os-volume_attachments/83c4015c-57cc-4a41-a30a-3bbe68459a06" status: 200 len: 194 microversion: 2.1 time: 0.073128 Jul 29 05:27:44.317046 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 464/883] 10.222.0.49 () {58 vars in 1413 bytes} [Fri Jul 29 05:27:44 2022] GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9/os-volume_attachments/83c4015c-57cc-4a41-a30a-3bbe68459a06 => generated 194 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:27:44.331125 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-14d56ad1-ec69-418d-be92-61d672b45368 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:44.332683 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-14d56ad1-ec69-418d-be92-61d672b45368 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:44.344423 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-14d56ad1-ec69-418d-be92-61d672b45368 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:44.345398 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-14d56ad1-ec69-418d-be92-61d672b45368 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:44.346695 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-14d56ad1-ec69-418d-be92-61d672b45368 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:44.347525 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-14d56ad1-ec69-418d-be92-61d672b45368 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:44.484921 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.objects.instance [None req-14d56ad1-ec69-418d-be92-61d672b45368 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lazy-loading 'services' on Instance uuid 62613145-ee65-4472-a5f6-23a6d76ea1b9 {{(pid=117820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:27:44.510061 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-3c25b476-2d2f-4419-98f7-cf5aae5d8b06 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:44.510784 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-3c25b476-2d2f-4419-98f7-cf5aae5d8b06 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:44.519288 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3c25b476-2d2f-4419-98f7-cf5aae5d8b06 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:44.519751 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3c25b476-2d2f-4419-98f7-cf5aae5d8b06 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:44.520770 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3c25b476-2d2f-4419-98f7-cf5aae5d8b06 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:44.521209 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3c25b476-2d2f-4419-98f7-cf5aae5d8b06 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:44.588837 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-14d56ad1-ec69-418d-be92-61d672b45368 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "DELETE /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9/os-volume_attachments/83c4015c-57cc-4a41-a30a-3bbe68459a06" status: 202 len: 0 microversion: 2.1 time: 0.265633 Jul 29 05:27:44.593660 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 420/884] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Jul 29 05:27:44 2022] DELETE /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9/os-volume_attachments/83c4015c-57cc-4a41-a30a-3bbe68459a06 => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 05:27:44.967725 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-3c25b476-2d2f-4419-98f7-cf5aae5d8b06 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792/os-volume_attachments/0ade6dea-1b44-46d0-9f83-ce5db1b1a45c" status: 202 len: 0 microversion: 2.20 time: 0.461339 Jul 29 05:27:44.968771 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 465/885] 10.222.0.49 () {60 vars in 1457 bytes} [Fri Jul 29 05:27:44 2022] DELETE /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792/os-volume_attachments/0ade6dea-1b44-46d0-9f83-ce5db1b1a45c => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 29 05:27:45.061390 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-2f5c67af-8d2a-4312-b01d-1d7e2f1a52cc tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:27:45.062739 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-2f5c67af-8d2a-4312-b01d-1d7e2f1a52cc tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:45.070383 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2f5c67af-8d2a-4312-b01d-1d7e2f1a52cc tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:45.070931 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2f5c67af-8d2a-4312-b01d-1d7e2f1a52cc tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:45.071904 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2f5c67af-8d2a-4312-b01d-1d7e2f1a52cc tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:45.072351 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2f5c67af-8d2a-4312-b01d-1d7e2f1a52cc tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:45.115124 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-2f5c67af-8d2a-4312-b01d-1d7e2f1a52cc tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117820) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 29 05:27:45.271785 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-2f5c67af-8d2a-4312-b01d-1d7e2f1a52cc tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "POST /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792/action" status: 202 len: 0 microversion: 2.20 time: 0.210077 Jul 29 05:27:45.273437 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 421/886] 10.222.0.49 () {62 vars in 1319 bytes} [Fri Jul 29 05:27:45 2022] POST /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 29 05:27:45.286689 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-02e69beb-6bf2-435c-b2c0-bf86d2b7b6a5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:45.292806 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-02e69beb-6bf2-435c-b2c0-bf86d2b7b6a5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:45.310890 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-02e69beb-6bf2-435c-b2c0-bf86d2b7b6a5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:45.311521 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-02e69beb-6bf2-435c-b2c0-bf86d2b7b6a5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:45.313381 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-02e69beb-6bf2-435c-b2c0-bf86d2b7b6a5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:45.314162 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-02e69beb-6bf2-435c-b2c0-bf86d2b7b6a5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:45.616602 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-02e69beb-6bf2-435c-b2c0-bf86d2b7b6a5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:45.630730 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-02e69beb-6bf2-435c-b2c0-bf86d2b7b6a5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:45.633956 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-02e69beb-6bf2-435c-b2c0-bf86d2b7b6a5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:45.638668 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-02e69beb-6bf2-435c-b2c0-bf86d2b7b6a5 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1671 microversion: 2.20 time: 0.357764 Jul 29 05:27:45.638668 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 466/887] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:45 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1671 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:27:45.887684 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-a132f7ae-7f70-4e13-b2d7-64afe4783794 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:45.890557 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-a132f7ae-7f70-4e13-b2d7-64afe4783794 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:45.897687 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a132f7ae-7f70-4e13-b2d7-64afe4783794 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:45.898135 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a132f7ae-7f70-4e13-b2d7-64afe4783794 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:45.899100 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a132f7ae-7f70-4e13-b2d7-64afe4783794 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:45.899747 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a132f7ae-7f70-4e13-b2d7-64afe4783794 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:45.936419 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-a132f7ae-7f70-4e13-b2d7-64afe4783794 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052378 Jul 29 05:27:45.938332 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 422/888] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:27:45 2022] GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 29 05:27:46.123053 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-f2104a03-7c60-4df3-a7ba-7d4c4aa1949f tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:46.126194 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-f2104a03-7c60-4df3-a7ba-7d4c4aa1949f tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:46.135997 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f2104a03-7c60-4df3-a7ba-7d4c4aa1949f tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:46.137222 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f2104a03-7c60-4df3-a7ba-7d4c4aa1949f tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:46.138548 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f2104a03-7c60-4df3-a7ba-7d4c4aa1949f tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:46.139187 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f2104a03-7c60-4df3-a7ba-7d4c4aa1949f tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:46.193376 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-f2104a03-7c60-4df3-a7ba-7d4c4aa1949f tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073535 Jul 29 05:27:46.194803 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 467/889] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:27:46 2022] GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 05:27:46.301888 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-6439781c-3dc5-46d1-bd52-7fcacf5397be tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:46.302792 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-6439781c-3dc5-46d1-bd52-7fcacf5397be tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:46.314051 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6439781c-3dc5-46d1-bd52-7fcacf5397be tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:46.314423 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6439781c-3dc5-46d1-bd52-7fcacf5397be tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:46.315929 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6439781c-3dc5-46d1-bd52-7fcacf5397be tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:46.316769 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6439781c-3dc5-46d1-bd52-7fcacf5397be tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:46.366185 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-6439781c-3dc5-46d1-bd52-7fcacf5397be tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Going to try to terminate instance {{(pid=117820) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 05:27:46.439092 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell1:UPDATE=8,nova_cell1:SELECT=86,nova_cell1:INSERT=6 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:27:46.518529 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-6439781c-3dc5-46d1-bd52-7fcacf5397be tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "DELETE /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9" status: 204 len: 0 microversion: 2.1 time: 0.223438 Jul 29 05:27:46.519265 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 423/890] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 05:27:46 2022] DELETE /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 29 05:27:46.528382 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-af5a90a7-f78b-4457-84df-0a1f7d1c5a94 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:46.529010 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-af5a90a7-f78b-4457-84df-0a1f7d1c5a94 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:46.550612 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-af5a90a7-f78b-4457-84df-0a1f7d1c5a94 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:46.551383 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-af5a90a7-f78b-4457-84df-0a1f7d1c5a94 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:46.552418 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-af5a90a7-f78b-4457-84df-0a1f7d1c5a94 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:46.553078 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-af5a90a7-f78b-4457-84df-0a1f7d1c5a94 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:46.676569 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-f6ddf10d-3555-4316-ae3e-8addf9e5d442 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:46.677710 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-f6ddf10d-3555-4316-ae3e-8addf9e5d442 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:46.684639 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f6ddf10d-3555-4316-ae3e-8addf9e5d442 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:46.685129 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f6ddf10d-3555-4316-ae3e-8addf9e5d442 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:46.685903 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f6ddf10d-3555-4316-ae3e-8addf9e5d442 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:46.686399 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f6ddf10d-3555-4316-ae3e-8addf9e5d442 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:46.748544 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-af5a90a7-f78b-4457-84df-0a1f7d1c5a94 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:46.777570 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-af5a90a7-f78b-4457-84df-0a1f7d1c5a94 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9" status: 200 len: 1672 microversion: 2.1 time: 0.247161 Jul 29 05:27:46.778805 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 468/891] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:46 2022] GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9 => generated 1672 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:27:46.921267 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-f6ddf10d-3555-4316-ae3e-8addf9e5d442 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:46.936070 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-f6ddf10d-3555-4316-ae3e-8addf9e5d442 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:46.939943 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-f6ddf10d-3555-4316-ae3e-8addf9e5d442 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:46.942062 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-f6ddf10d-3555-4316-ae3e-8addf9e5d442 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1729 microversion: 2.20 time: 0.269722 Jul 29 05:27:46.943031 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 424/892] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:46 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1729 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:27:47.814174 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-116e861d-ff52-4f85-b435-2436cab7be23 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:47.814801 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-116e861d-ff52-4f85-b435-2436cab7be23 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:47.821643 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-116e861d-ff52-4f85-b435-2436cab7be23 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:47.822103 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-116e861d-ff52-4f85-b435-2436cab7be23 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:47.822892 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-116e861d-ff52-4f85-b435-2436cab7be23 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:47.823335 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-116e861d-ff52-4f85-b435-2436cab7be23 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:47.975737 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-a8de3ec3-1170-4fa3-98b6-d2eae53d4a30 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:47.977053 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-a8de3ec3-1170-4fa3-98b6-d2eae53d4a30 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:47.993062 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a8de3ec3-1170-4fa3-98b6-d2eae53d4a30 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:47.993924 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a8de3ec3-1170-4fa3-98b6-d2eae53d4a30 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:47.995249 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a8de3ec3-1170-4fa3-98b6-d2eae53d4a30 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:47.996277 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a8de3ec3-1170-4fa3-98b6-d2eae53d4a30 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:48.018091 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-116e861d-ff52-4f85-b435-2436cab7be23 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:48.027542 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-116e861d-ff52-4f85-b435-2436cab7be23 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9" status: 200 len: 1672 microversion: 2.1 time: 0.217158 Jul 29 05:27:48.033052 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 469/893] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:47 2022] GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9 => generated 1672 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:27:48.195324 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-a8de3ec3-1170-4fa3-98b6-d2eae53d4a30 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:48.210255 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-a8de3ec3-1170-4fa3-98b6-d2eae53d4a30 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:48.213074 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-a8de3ec3-1170-4fa3-98b6-d2eae53d4a30 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:48.215177 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-a8de3ec3-1170-4fa3-98b6-d2eae53d4a30 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1729 microversion: 2.20 time: 0.247306 Jul 29 05:27:48.216514 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 425/894] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:47 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1729 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:27:49.059960 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-850768d3-b309-40d4-89c6-15d09658dbbd tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:49.061453 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-850768d3-b309-40d4-89c6-15d09658dbbd tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:49.072373 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-850768d3-b309-40d4-89c6-15d09658dbbd tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:49.073270 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-850768d3-b309-40d4-89c6-15d09658dbbd tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:49.074699 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-850768d3-b309-40d4-89c6-15d09658dbbd tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:49.075841 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-850768d3-b309-40d4-89c6-15d09658dbbd tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:49.244052 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-8c1bac2e-d0af-46b3-b9ec-098130ed8884 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:49.247126 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-8c1bac2e-d0af-46b3-b9ec-098130ed8884 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:49.262785 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-850768d3-b309-40d4-89c6-15d09658dbbd tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:49.266736 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8c1bac2e-d0af-46b3-b9ec-098130ed8884 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:49.269268 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8c1bac2e-d0af-46b3-b9ec-098130ed8884 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:49.271597 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8c1bac2e-d0af-46b3-b9ec-098130ed8884 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:49.273761 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8c1bac2e-d0af-46b3-b9ec-098130ed8884 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:49.274889 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-850768d3-b309-40d4-89c6-15d09658dbbd tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9" status: 200 len: 1672 microversion: 2.1 time: 0.221161 Jul 29 05:27:49.276531 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 470/895] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:49 2022] GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9 => generated 1672 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:27:49.682401 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-8c1bac2e-d0af-46b3-b9ec-098130ed8884 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:49.693858 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-8c1bac2e-d0af-46b3-b9ec-098130ed8884 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:49.695551 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-8c1bac2e-d0af-46b3-b9ec-098130ed8884 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:49.696931 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-8c1bac2e-d0af-46b3-b9ec-098130ed8884 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1729 microversion: 2.20 time: 0.460283 Jul 29 05:27:49.699624 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 426/896] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:49 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1729 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:27:50.300820 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-6dbec62e-2e7c-4cf7-ae0c-5e986b21e334 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:50.302980 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-6dbec62e-2e7c-4cf7-ae0c-5e986b21e334 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:50.315463 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6dbec62e-2e7c-4cf7-ae0c-5e986b21e334 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:50.316225 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6dbec62e-2e7c-4cf7-ae0c-5e986b21e334 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:50.317707 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6dbec62e-2e7c-4cf7-ae0c-5e986b21e334 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:50.318592 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6dbec62e-2e7c-4cf7-ae0c-5e986b21e334 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:50.427314 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-6dbec62e-2e7c-4cf7-ae0c-5e986b21e334 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:50.445167 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-6dbec62e-2e7c-4cf7-ae0c-5e986b21e334 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9" status: 200 len: 1605 microversion: 2.1 time: 0.149845 Jul 29 05:27:50.447902 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 471/897] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:50 2022] GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9 => generated 1605 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:27:50.674538 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-53516b9c-c568-45f2-8736-e7e7464cb878 req-438c967b-56ab-4c8c-8ac4-671d82776f67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62613145-ee65-4472-a5f6-23a6d76ea1b9", "name": "network-vif-deleted", "tag": "a7825eab-725a-4a03-8c38-040b1712a57c"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:27:50.703454 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-53516b9c-c568-45f2-8736-e7e7464cb878 req-438c967b-56ab-4c8c-8ac4-671d82776f67 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:50.704535 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-53516b9c-c568-45f2-8736-e7e7464cb878 req-438c967b-56ab-4c8c-8ac4-671d82776f67 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:50.737201 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-f1ee32f4-fd21-4dd6-8473-db5d3e28ea09 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:50.738361 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-f1ee32f4-fd21-4dd6-8473-db5d3e28ea09 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:50.766426 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f1ee32f4-fd21-4dd6-8473-db5d3e28ea09 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:50.772918 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f1ee32f4-fd21-4dd6-8473-db5d3e28ea09 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:50.778700 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f1ee32f4-fd21-4dd6-8473-db5d3e28ea09 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:50.783213 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f1ee32f4-fd21-4dd6-8473-db5d3e28ea09 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:50.802481 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-53516b9c-c568-45f2-8736-e7e7464cb878 req-438c967b-56ab-4c8c-8ac4-671d82776f67 service nova] Creating event network-vif-deleted:a7825eab-725a-4a03-8c38-040b1712a57c for instance 62613145-ee65-4472-a5f6-23a6d76ea1b9 on hv-cinder-85127 Jul 29 05:27:50.838263 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-53516b9c-c568-45f2-8736-e7e7464cb878 req-438c967b-56ab-4c8c-8ac4-671d82776f67 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168677 Jul 29 05:27:50.851413 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 427/898] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:27:51.277815 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-f1ee32f4-fd21-4dd6-8473-db5d3e28ea09 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:51.289403 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-f1ee32f4-fd21-4dd6-8473-db5d3e28ea09 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:51.291711 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-f1ee32f4-fd21-4dd6-8473-db5d3e28ea09 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:51.293240 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-f1ee32f4-fd21-4dd6-8473-db5d3e28ea09 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1729 microversion: 2.20 time: 0.561583 Jul 29 05:27:51.294356 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 472/899] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:50 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1729 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:27:51.476887 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-2573c42b-3274-42fb-8d35-9e67b4b46e2a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:51.479047 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-2573c42b-3274-42fb-8d35-9e67b4b46e2a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:51.499822 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2573c42b-3274-42fb-8d35-9e67b4b46e2a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:51.500340 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2573c42b-3274-42fb-8d35-9e67b4b46e2a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:51.501590 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2573c42b-3274-42fb-8d35-9e67b4b46e2a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:51.502112 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2573c42b-3274-42fb-8d35-9e67b4b46e2a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:51.603756 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2573c42b-3274-42fb-8d35-9e67b4b46e2a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:51.604911 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2573c42b-3274-42fb-8d35-9e67b4b46e2a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:51.604911 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.objects.instance [None req-2573c42b-3274-42fb-8d35-9e67b4b46e2a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lazy-loading 'fault' on Instance uuid 62613145-ee65-4472-a5f6-23a6d76ea1b9 {{(pid=117820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:27:51.715083 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-2573c42b-3274-42fb-8d35-9e67b4b46e2a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:51.732306 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-2573c42b-3274-42fb-8d35-9e67b4b46e2a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9" status: 200 len: 1328 microversion: 2.1 time: 0.266400 Jul 29 05:27:51.733506 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 428/900] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:51 2022] GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9 => generated 1328 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:27:52.322196 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-d636c5e7-4a4e-441e-96c0-8ee42ed053d0 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:52.323299 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-d636c5e7-4a4e-441e-96c0-8ee42ed053d0 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:52.342290 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d636c5e7-4a4e-441e-96c0-8ee42ed053d0 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:52.343645 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d636c5e7-4a4e-441e-96c0-8ee42ed053d0 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:52.345415 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d636c5e7-4a4e-441e-96c0-8ee42ed053d0 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:52.346473 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d636c5e7-4a4e-441e-96c0-8ee42ed053d0 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:52.438683 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-bd6507ba-0af7-4169-a2ae-e7202712073b tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:27:52.442418 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-bd6507ba-0af7-4169-a2ae-e7202712073b tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:52.451317 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bd6507ba-0af7-4169-a2ae-e7202712073b tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:52.453266 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bd6507ba-0af7-4169-a2ae-e7202712073b tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:52.454667 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bd6507ba-0af7-4169-a2ae-e7202712073b tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:52.455416 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bd6507ba-0af7-4169-a2ae-e7202712073b tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:52.637663 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-bd6507ba-0af7-4169-a2ae-e7202712073b tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "POST /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/action" status: 202 len: 0 microversion: 2.1 time: 0.203554 Jul 29 05:27:52.639478 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 429/901] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Jul 29 05:27:52 2022] POST /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 05:27:52.641975 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-d636c5e7-4a4e-441e-96c0-8ee42ed053d0 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:52.656778 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-caf58877-6a73-4b5e-8f12-19f5e8126f89 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:52.658483 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-caf58877-6a73-4b5e-8f12-19f5e8126f89 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:52.664111 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-d636c5e7-4a4e-441e-96c0-8ee42ed053d0 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:52.666142 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-d636c5e7-4a4e-441e-96c0-8ee42ed053d0 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:52.667650 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-d636c5e7-4a4e-441e-96c0-8ee42ed053d0 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1729 microversion: 2.20 time: 0.352593 Jul 29 05:27:52.671440 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-caf58877-6a73-4b5e-8f12-19f5e8126f89 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:52.671940 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 473/902] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:52 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1729 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:27:52.673283 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-caf58877-6a73-4b5e-8f12-19f5e8126f89 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:52.674985 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-caf58877-6a73-4b5e-8f12-19f5e8126f89 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:52.676057 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-caf58877-6a73-4b5e-8f12-19f5e8126f89 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:52.772538 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-6fdeb910-fac6-47a3-92ee-718d35c9bdb4 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:52.773569 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-6fdeb910-fac6-47a3-92ee-718d35c9bdb4 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:52.790445 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6fdeb910-fac6-47a3-92ee-718d35c9bdb4 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:52.792730 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6fdeb910-fac6-47a3-92ee-718d35c9bdb4 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:52.796777 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6fdeb910-fac6-47a3-92ee-718d35c9bdb4 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:52.797669 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6fdeb910-fac6-47a3-92ee-718d35c9bdb4 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:52.868893 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6fdeb910-fac6-47a3-92ee-718d35c9bdb4 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:52.869751 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6fdeb910-fac6-47a3-92ee-718d35c9bdb4 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:52.870996 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.objects.instance [None req-6fdeb910-fac6-47a3-92ee-718d35c9bdb4 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lazy-loading 'fault' on Instance uuid 62613145-ee65-4472-a5f6-23a6d76ea1b9 {{(pid=117821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:27:52.877531 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:27:52.918602 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-caf58877-6a73-4b5e-8f12-19f5e8126f89 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:52.949085 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-6fdeb910-fac6-47a3-92ee-718d35c9bdb4 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:52.950386 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-caf58877-6a73-4b5e-8f12-19f5e8126f89 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1750 microversion: 2.1 time: 0.305463 Jul 29 05:27:52.960216 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 430/903] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:52 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1750 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:27:52.969769 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-6fdeb910-fac6-47a3-92ee-718d35c9bdb4 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9" status: 200 len: 1328 microversion: 2.1 time: 0.202327 Jul 29 05:27:52.975858 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 474/904] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:52 2022] GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9 => generated 1328 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:27:53.692394 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-5176f546-2163-4e8c-a9e1-9288f9072881 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:53.693535 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-5176f546-2163-4e8c-a9e1-9288f9072881 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:53.705770 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5176f546-2163-4e8c-a9e1-9288f9072881 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:53.706134 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5176f546-2163-4e8c-a9e1-9288f9072881 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:53.706927 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5176f546-2163-4e8c-a9e1-9288f9072881 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:53.707397 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5176f546-2163-4e8c-a9e1-9288f9072881 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:53.968072 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-5176f546-2163-4e8c-a9e1-9288f9072881 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:53.979967 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-5176f546-2163-4e8c-a9e1-9288f9072881 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:53.982155 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-5176f546-2163-4e8c-a9e1-9288f9072881 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:53.984327 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-5176f546-2163-4e8c-a9e1-9288f9072881 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1729 microversion: 2.20 time: 0.296697 Jul 29 05:27:53.985082 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 431/905] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:53 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1729 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:27:53.985826 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-67729ee0-a02c-4e3f-8b18-dc328e3ecc6f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:53.986855 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-67729ee0-a02c-4e3f-8b18-dc328e3ecc6f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:53.995580 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-67729ee0-a02c-4e3f-8b18-dc328e3ecc6f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:53.996355 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-67729ee0-a02c-4e3f-8b18-dc328e3ecc6f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:53.997548 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-67729ee0-a02c-4e3f-8b18-dc328e3ecc6f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:53.998144 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-67729ee0-a02c-4e3f-8b18-dc328e3ecc6f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:54.013281 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-cad55b7e-865b-466c-afe3-e7e520b9a744 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:54.015295 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-cad55b7e-865b-466c-afe3-e7e520b9a744 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:54.027185 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-cad55b7e-865b-466c-afe3-e7e520b9a744 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:54.028011 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-cad55b7e-865b-466c-afe3-e7e520b9a744 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:54.029475 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-cad55b7e-865b-466c-afe3-e7e520b9a744 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:54.030444 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-cad55b7e-865b-466c-afe3-e7e520b9a744 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:54.114847 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-cad55b7e-865b-466c-afe3-e7e520b9a744 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:54.116269 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-cad55b7e-865b-466c-afe3-e7e520b9a744 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:54.132529 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.objects.instance [None req-cad55b7e-865b-466c-afe3-e7e520b9a744 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lazy-loading 'fault' on Instance uuid 62613145-ee65-4472-a5f6-23a6d76ea1b9 {{(pid=117820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:27:54.216928 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-cad55b7e-865b-466c-afe3-e7e520b9a744 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:54.237789 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-cad55b7e-865b-466c-afe3-e7e520b9a744 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9" status: 200 len: 1328 microversion: 2.1 time: 0.231006 Jul 29 05:27:54.252488 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 432/906] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:54 2022] GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9 => generated 1328 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:27:54.325780 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-67729ee0-a02c-4e3f-8b18-dc328e3ecc6f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:54.338509 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-67729ee0-a02c-4e3f-8b18-dc328e3ecc6f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1750 microversion: 2.1 time: 0.359383 Jul 29 05:27:54.339302 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 475/907] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:53 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1750 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:27:55.017853 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-9adfbcf3-fb75-4064-a905-1333ab5aad47 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:55.018930 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-9adfbcf3-fb75-4064-a905-1333ab5aad47 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:55.027163 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9adfbcf3-fb75-4064-a905-1333ab5aad47 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:55.027643 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9adfbcf3-fb75-4064-a905-1333ab5aad47 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:55.028425 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9adfbcf3-fb75-4064-a905-1333ab5aad47 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:55.028857 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9adfbcf3-fb75-4064-a905-1333ab5aad47 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:55.232328 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-9adfbcf3-fb75-4064-a905-1333ab5aad47 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:55.255898 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-9adfbcf3-fb75-4064-a905-1333ab5aad47 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:55.260160 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-9adfbcf3-fb75-4064-a905-1333ab5aad47 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:55.262541 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-9adfbcf3-fb75-4064-a905-1333ab5aad47 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1729 microversion: 2.20 time: 0.252020 Jul 29 05:27:55.263742 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 433/908] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:55 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1729 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:27:55.278262 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-17c4a114-5a27-46fe-9164-ca4f75bd45f8 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:55.279926 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-17c4a114-5a27-46fe-9164-ca4f75bd45f8 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:55.294443 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-17c4a114-5a27-46fe-9164-ca4f75bd45f8 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:55.295187 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-17c4a114-5a27-46fe-9164-ca4f75bd45f8 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:55.300214 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-17c4a114-5a27-46fe-9164-ca4f75bd45f8 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:55.301949 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-17c4a114-5a27-46fe-9164-ca4f75bd45f8 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:55.373574 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-994c966b-8abf-4957-925a-fd85b6717bd2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:55.373574 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-994c966b-8abf-4957-925a-fd85b6717bd2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:55.376952 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-17c4a114-5a27-46fe-9164-ca4f75bd45f8 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:55.377601 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-17c4a114-5a27-46fe-9164-ca4f75bd45f8 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:55.378179 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.objects.instance [None req-17c4a114-5a27-46fe-9164-ca4f75bd45f8 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lazy-loading 'fault' on Instance uuid 62613145-ee65-4472-a5f6-23a6d76ea1b9 {{(pid=117821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:27:55.379557 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-994c966b-8abf-4957-925a-fd85b6717bd2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:55.380429 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-994c966b-8abf-4957-925a-fd85b6717bd2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:55.381925 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-994c966b-8abf-4957-925a-fd85b6717bd2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:55.382659 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-994c966b-8abf-4957-925a-fd85b6717bd2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:55.441885 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-17c4a114-5a27-46fe-9164-ca4f75bd45f8 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:55.451482 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-17c4a114-5a27-46fe-9164-ca4f75bd45f8 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9" status: 200 len: 1328 microversion: 2.1 time: 0.177628 Jul 29 05:27:55.453470 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 476/909] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:55 2022] GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9 => generated 1328 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:27:55.753196 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-994c966b-8abf-4957-925a-fd85b6717bd2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:55.767864 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-994c966b-8abf-4957-925a-fd85b6717bd2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1750 microversion: 2.1 time: 0.403511 Jul 29 05:27:55.768660 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 434/910] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:55 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1750 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:27:56.310385 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-afb176f7-672d-4c62-a92a-1efb2449a92c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:56.312455 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-afb176f7-672d-4c62-a92a-1efb2449a92c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:56.322430 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-afb176f7-672d-4c62-a92a-1efb2449a92c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:56.322958 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-afb176f7-672d-4c62-a92a-1efb2449a92c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:56.324254 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-afb176f7-672d-4c62-a92a-1efb2449a92c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:56.324986 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-afb176f7-672d-4c62-a92a-1efb2449a92c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:56.474646 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-973bb03a-527c-45bb-958f-8eb49cdef46a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:56.475497 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-973bb03a-527c-45bb-958f-8eb49cdef46a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:56.484314 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-973bb03a-527c-45bb-958f-8eb49cdef46a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:56.484891 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-973bb03a-527c-45bb-958f-8eb49cdef46a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:56.485738 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-973bb03a-527c-45bb-958f-8eb49cdef46a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:56.486183 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-973bb03a-527c-45bb-958f-8eb49cdef46a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:56.527262 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-973bb03a-527c-45bb-958f-8eb49cdef46a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:56.528054 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-973bb03a-527c-45bb-958f-8eb49cdef46a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:56.528682 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.objects.instance [None req-973bb03a-527c-45bb-958f-8eb49cdef46a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lazy-loading 'fault' on Instance uuid 62613145-ee65-4472-a5f6-23a6d76ea1b9 {{(pid=117820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:27:56.572436 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-afb176f7-672d-4c62-a92a-1efb2449a92c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:56.589554 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-afb176f7-672d-4c62-a92a-1efb2449a92c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:56.594530 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-afb176f7-672d-4c62-a92a-1efb2449a92c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:56.597410 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-afb176f7-672d-4c62-a92a-1efb2449a92c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1729 microversion: 2.20 time: 0.291197 Jul 29 05:27:56.599455 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 477/911] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:56 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1729 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:27:56.606313 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-973bb03a-527c-45bb-958f-8eb49cdef46a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:56.621628 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-973bb03a-527c-45bb-958f-8eb49cdef46a tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9" status: 200 len: 1328 microversion: 2.1 time: 0.150981 Jul 29 05:27:56.623177 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 435/912] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:56 2022] GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9 => generated 1328 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:27:56.805993 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-341e0a12-8db6-4817-acef-11af17d16204 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:56.806613 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-341e0a12-8db6-4817-acef-11af17d16204 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:56.815011 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-341e0a12-8db6-4817-acef-11af17d16204 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:56.815734 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-341e0a12-8db6-4817-acef-11af17d16204 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:56.816612 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-341e0a12-8db6-4817-acef-11af17d16204 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:56.817187 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-341e0a12-8db6-4817-acef-11af17d16204 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:57.093160 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-341e0a12-8db6-4817-acef-11af17d16204 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:57.110628 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-341e0a12-8db6-4817-acef-11af17d16204 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1750 microversion: 2.1 time: 0.308093 Jul 29 05:27:57.112596 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 478/913] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:56 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1750 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:27:57.627810 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-68643279-3c78-4820-9f5a-cce28d45d393 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:57.628961 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-68643279-3c78-4820-9f5a-cce28d45d393 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:57.641269 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-68643279-3c78-4820-9f5a-cce28d45d393 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:57.642469 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-68643279-3c78-4820-9f5a-cce28d45d393 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:57.643935 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-68643279-3c78-4820-9f5a-cce28d45d393 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:57.644985 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-68643279-3c78-4820-9f5a-cce28d45d393 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:57.651870 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-46dd5194-1a62-42cb-bef8-a007645f2c71 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:57.652786 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-46dd5194-1a62-42cb-bef8-a007645f2c71 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:57.667816 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-46dd5194-1a62-42cb-bef8-a007645f2c71 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:57.669692 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-46dd5194-1a62-42cb-bef8-a007645f2c71 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:57.671950 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-46dd5194-1a62-42cb-bef8-a007645f2c71 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:57.675063 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-46dd5194-1a62-42cb-bef8-a007645f2c71 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:57.741722 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-46dd5194-1a62-42cb-bef8-a007645f2c71 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:57.742365 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-46dd5194-1a62-42cb-bef8-a007645f2c71 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:57.743033 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.objects.instance [None req-46dd5194-1a62-42cb-bef8-a007645f2c71 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lazy-loading 'fault' on Instance uuid 62613145-ee65-4472-a5f6-23a6d76ea1b9 {{(pid=117821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:27:57.815180 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-46dd5194-1a62-42cb-bef8-a007645f2c71 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:57.836911 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-46dd5194-1a62-42cb-bef8-a007645f2c71 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9" status: 200 len: 1328 microversion: 2.1 time: 0.189743 Jul 29 05:27:57.837933 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 479/914] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:57 2022] GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9 => generated 1328 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:27:57.893306 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-68643279-3c78-4820-9f5a-cce28d45d393 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:57.902456 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-68643279-3c78-4820-9f5a-cce28d45d393 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:57.904066 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-68643279-3c78-4820-9f5a-cce28d45d393 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:57.906319 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-68643279-3c78-4820-9f5a-cce28d45d393 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1729 microversion: 2.20 time: 0.286916 Jul 29 05:27:57.906925 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 436/915] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:57 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1729 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:27:58.146034 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-bed5f711-a415-4e50-9e8a-b30c7235ae04 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:58.146569 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-bed5f711-a415-4e50-9e8a-b30c7235ae04 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:58.153329 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bed5f711-a415-4e50-9e8a-b30c7235ae04 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:58.153790 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bed5f711-a415-4e50-9e8a-b30c7235ae04 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:58.154577 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bed5f711-a415-4e50-9e8a-b30c7235ae04 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:58.155572 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bed5f711-a415-4e50-9e8a-b30c7235ae04 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:58.361266 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-bed5f711-a415-4e50-9e8a-b30c7235ae04 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:58.377412 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-bed5f711-a415-4e50-9e8a-b30c7235ae04 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1750 microversion: 2.1 time: 0.235151 Jul 29 05:27:58.378487 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 480/916] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:58 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1750 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:27:58.870351 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-f8158cac-2a1f-44e7-b860-f13f701df7fc tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:58.873370 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-f8158cac-2a1f-44e7-b860-f13f701df7fc tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:58.910409 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f8158cac-2a1f-44e7-b860-f13f701df7fc tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:58.911564 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f8158cac-2a1f-44e7-b860-f13f701df7fc tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:58.913701 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f8158cac-2a1f-44e7-b860-f13f701df7fc tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:58.916159 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f8158cac-2a1f-44e7-b860-f13f701df7fc tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:58.931306 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-976c8556-a455-4a73-8c8e-c67a0583282b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:58.932297 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-976c8556-a455-4a73-8c8e-c67a0583282b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:58.939485 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-976c8556-a455-4a73-8c8e-c67a0583282b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:58.940294 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-976c8556-a455-4a73-8c8e-c67a0583282b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:58.941271 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-976c8556-a455-4a73-8c8e-c67a0583282b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:58.941889 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-976c8556-a455-4a73-8c8e-c67a0583282b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:58.993263 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f8158cac-2a1f-44e7-b860-f13f701df7fc tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:58.996230 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f8158cac-2a1f-44e7-b860-f13f701df7fc tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:58.997292 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.objects.instance [None req-f8158cac-2a1f-44e7-b860-f13f701df7fc tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lazy-loading 'fault' on Instance uuid 62613145-ee65-4472-a5f6-23a6d76ea1b9 {{(pid=117820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:27:59.110639 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-f8158cac-2a1f-44e7-b860-f13f701df7fc tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:59.181425 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-f8158cac-2a1f-44e7-b860-f13f701df7fc tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9" status: 200 len: 1328 microversion: 2.1 time: 0.321080 Jul 29 05:27:59.183057 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 437/917] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:58 2022] GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9 => generated 1328 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:27:59.284056 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-976c8556-a455-4a73-8c8e-c67a0583282b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:59.299693 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-976c8556-a455-4a73-8c8e-c67a0583282b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:59.301811 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-976c8556-a455-4a73-8c8e-c67a0583282b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:59.303314 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-976c8556-a455-4a73-8c8e-c67a0583282b tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1729 microversion: 2.20 time: 0.375909 Jul 29 05:27:59.311776 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 481/918] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:27:58 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1729 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:27:59.436698 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-38a17361-9ab5-4f3d-a362-36b893842fda tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:27:59.437681 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-38a17361-9ab5-4f3d-a362-36b893842fda tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:27:59.449588 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-38a17361-9ab5-4f3d-a362-36b893842fda tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:59.450944 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-38a17361-9ab5-4f3d-a362-36b893842fda tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:59.453215 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-38a17361-9ab5-4f3d-a362-36b893842fda tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:27:59.453996 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-38a17361-9ab5-4f3d-a362-36b893842fda tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:27:59.462777 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:27:59.806679 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-38a17361-9ab5-4f3d-a362-36b893842fda tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:27:59.822037 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-38a17361-9ab5-4f3d-a362-36b893842fda tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1750 microversion: 2.1 time: 0.400156 Jul 29 05:27:59.839869 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 438/919] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:27:59 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1750 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:28:00.120568 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-a4bb2080-e1bc-4755-ac70-2c5ec3815fa9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:00.122520 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-a4bb2080-e1bc-4755-ac70-2c5ec3815fa9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: c7d28599-67a9-4e84-a44d-79f1a6bf728f] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:00.133796 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a4bb2080-e1bc-4755-ac70-2c5ec3815fa9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:00.134659 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a4bb2080-e1bc-4755-ac70-2c5ec3815fa9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:00.135752 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a4bb2080-e1bc-4755-ac70-2c5ec3815fa9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:00.136234 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a4bb2080-e1bc-4755-ac70-2c5ec3815fa9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:00.186307 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-a4bb2080-e1bc-4755-ac70-2c5ec3815fa9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f/ips" status: 200 len: 149 microversion: 2.1 time: 0.074793 Jul 29 05:28:00.187802 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 482/920] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Jul 29 05:28:00 2022] GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f/ips => generated 149 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:28:00.220812 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-1e0b3cb3-b837-419d-8ec7-97db76a9c177 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:00.221216 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-1e0b3cb3-b837-419d-8ec7-97db76a9c177 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:00.229692 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1e0b3cb3-b837-419d-8ec7-97db76a9c177 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:00.230298 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1e0b3cb3-b837-419d-8ec7-97db76a9c177 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:00.231398 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1e0b3cb3-b837-419d-8ec7-97db76a9c177 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:00.232435 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1e0b3cb3-b837-419d-8ec7-97db76a9c177 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:00.273457 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1e0b3cb3-b837-419d-8ec7-97db76a9c177 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:00.273917 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1e0b3cb3-b837-419d-8ec7-97db76a9c177 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:00.274383 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.objects.instance [None req-1e0b3cb3-b837-419d-8ec7-97db76a9c177 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lazy-loading 'fault' on Instance uuid 62613145-ee65-4472-a5f6-23a6d76ea1b9 {{(pid=117820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:28:00.358351 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-8130db1f-0228-4ba6-94b2-1b60eefc8e67 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:00.359402 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-8130db1f-0228-4ba6-94b2-1b60eefc8e67 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:00.361434 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-1e0b3cb3-b837-419d-8ec7-97db76a9c177 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:00.371540 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8130db1f-0228-4ba6-94b2-1b60eefc8e67 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:00.372964 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8130db1f-0228-4ba6-94b2-1b60eefc8e67 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:00.374087 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-1e0b3cb3-b837-419d-8ec7-97db76a9c177 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9" status: 200 len: 1328 microversion: 2.1 time: 0.157821 Jul 29 05:28:00.374890 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 439/921] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:28:00 2022] GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9 => generated 1328 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:28:00.376424 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8130db1f-0228-4ba6-94b2-1b60eefc8e67 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:00.377200 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8130db1f-0228-4ba6-94b2-1b60eefc8e67 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:00.665500 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-8130db1f-0228-4ba6-94b2-1b60eefc8e67 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:00.680189 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-8130db1f-0228-4ba6-94b2-1b60eefc8e67 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:00.683685 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-8130db1f-0228-4ba6-94b2-1b60eefc8e67 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:00.686497 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-8130db1f-0228-4ba6-94b2-1b60eefc8e67 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1729 microversion: 2.20 time: 0.335451 Jul 29 05:28:00.688020 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 483/922] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:28:00 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1729 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:28:00.862941 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-f9929183-5628-4a04-88fe-a7aa40c01a4e tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:00.863595 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-f9929183-5628-4a04-88fe-a7aa40c01a4e tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:00.870269 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f9929183-5628-4a04-88fe-a7aa40c01a4e tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:00.871065 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f9929183-5628-4a04-88fe-a7aa40c01a4e tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:00.872172 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f9929183-5628-4a04-88fe-a7aa40c01a4e tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:00.872673 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f9929183-5628-4a04-88fe-a7aa40c01a4e tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:01.094537 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-f9929183-5628-4a04-88fe-a7aa40c01a4e tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:01.104009 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-f9929183-5628-4a04-88fe-a7aa40c01a4e tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1750 microversion: 2.1 time: 0.246072 Jul 29 05:28:01.105062 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 440/923] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:28:00 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1750 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:28:01.406433 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-a80df10b-02f5-46a9-b774-3abefdf3f779 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:01.407490 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-a80df10b-02f5-46a9-b774-3abefdf3f779 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:01.415515 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a80df10b-02f5-46a9-b774-3abefdf3f779 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:01.415967 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a80df10b-02f5-46a9-b774-3abefdf3f779 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:01.416757 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a80df10b-02f5-46a9-b774-3abefdf3f779 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:01.417415 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a80df10b-02f5-46a9-b774-3abefdf3f779 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:01.462368 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a80df10b-02f5-46a9-b774-3abefdf3f779 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:01.463092 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a80df10b-02f5-46a9-b774-3abefdf3f779 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:01.463937 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.objects.instance [None req-a80df10b-02f5-46a9-b774-3abefdf3f779 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lazy-loading 'fault' on Instance uuid 62613145-ee65-4472-a5f6-23a6d76ea1b9 {{(pid=117821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:28:01.519977 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-a80df10b-02f5-46a9-b774-3abefdf3f779 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2db6ada97da4ee89f3ce8de98f2653a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f16adc2357459aa0afb68db89031dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:01.530363 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-a80df10b-02f5-46a9-b774-3abefdf3f779 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9" status: 200 len: 1328 microversion: 2.1 time: 0.128570 Jul 29 05:28:01.531206 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 484/924] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:28:01 2022] GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9 => generated 1328 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:28:01.720384 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-81dee60c-b455-460a-8a4c-41676030dcc2 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "363fc012-36fa-44e7-bafa-fbf1643b6ea9"}} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:28:01.726386 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-81dee60c-b455-460a-8a4c-41676030dcc2 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: c7d28599-67a9-4e84-a44d-79f1a6bf728f] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:01.730679 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-d0c85e03-adfd-4969-bc70-8445d4fbeb4a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:01.731885 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-d0c85e03-adfd-4969-bc70-8445d4fbeb4a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:01.738324 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-81dee60c-b455-460a-8a4c-41676030dcc2 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:01.738781 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-81dee60c-b455-460a-8a4c-41676030dcc2 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:01.740603 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-81dee60c-b455-460a-8a4c-41676030dcc2 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:01.741235 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-81dee60c-b455-460a-8a4c-41676030dcc2 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:01.746392 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d0c85e03-adfd-4969-bc70-8445d4fbeb4a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:01.747589 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d0c85e03-adfd-4969-bc70-8445d4fbeb4a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:01.749563 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d0c85e03-adfd-4969-bc70-8445d4fbeb4a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:01.750809 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d0c85e03-adfd-4969-bc70-8445d4fbeb4a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:02.040554 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-d0c85e03-adfd-4969-bc70-8445d4fbeb4a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:02.051582 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-d0c85e03-adfd-4969-bc70-8445d4fbeb4a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:02.053460 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-d0c85e03-adfd-4969-bc70-8445d4fbeb4a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:02.055455 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-d0c85e03-adfd-4969-bc70-8445d4fbeb4a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1729 microversion: 2.20 time: 0.333599 Jul 29 05:28:02.069718 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 485/925] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:28:01 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1729 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:28:02.110858 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-81dee60c-b455-460a-8a4c-41676030dcc2 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "POST /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.396836 Jul 29 05:28:02.112205 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 441/926] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Jul 29 05:28:01 2022] POST /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f/os-volume_attachments => generated 194 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:28:02.128428 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-f62a4ae6-47b7-4dca-ab14-80e2cfd0a31b tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:02.128624 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-f62a4ae6-47b7-4dca-ab14-80e2cfd0a31b tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:02.136648 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f62a4ae6-47b7-4dca-ab14-80e2cfd0a31b tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:02.137113 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f62a4ae6-47b7-4dca-ab14-80e2cfd0a31b tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:02.138206 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f62a4ae6-47b7-4dca-ab14-80e2cfd0a31b tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:02.139543 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f62a4ae6-47b7-4dca-ab14-80e2cfd0a31b tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:02.371733 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-f62a4ae6-47b7-4dca-ab14-80e2cfd0a31b tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:02.381515 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-f62a4ae6-47b7-4dca-ab14-80e2cfd0a31b tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1750 microversion: 2.1 time: 0.259105 Jul 29 05:28:02.395600 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 486/927] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:28:02 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1750 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:28:02.552537 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-0c441a7a-0a9b-4613-988f-43179fa516a4 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:02.553252 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-0c441a7a-0a9b-4613-988f-43179fa516a4 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:02.561298 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0c441a7a-0a9b-4613-988f-43179fa516a4 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:02.562243 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0c441a7a-0a9b-4613-988f-43179fa516a4 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:02.563077 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0c441a7a-0a9b-4613-988f-43179fa516a4 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:02.563565 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0c441a7a-0a9b-4613-988f-43179fa516a4 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:02.580365 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.wsgi [None req-0c441a7a-0a9b-4613-988f-43179fa516a4 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] HTTP exception thrown: Instance 62613145-ee65-4472-a5f6-23a6d76ea1b9 could not be found. Jul 29 05:28:02.582420 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-0c441a7a-0a9b-4613-988f-43179fa516a4 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Request method failure captured: Jul 29 05:28:02.582420 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: request: GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9 HTTP/1.1 Jul 29 05:28:02.582420 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept: application/json Jul 29 05:28:02.582420 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept-Encoding: identity Jul 29 05:28:02.582420 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Connection: close Jul 29 05:28:02.582420 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Length: 0 Jul 29 05:28:02.582420 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Type: application/json Jul 29 05:28:02.582420 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Host: 10.222.0.49 Jul 29 05:28:02.582420 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Openstack-System-Scope: None Jul 29 05:28:02.582420 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: User-Agent: python-urllib3/1.26.10 Jul 29 05:28:02.582420 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Auth-Token: gAAAAABi425XzClJm-mqNh7trJiRa8zhb1JdfD6kuObTAyJnIB1UhZxLI0lbverA-I-cqLqY2-6zazXj0ABWM0tRJVMiiwcj6fNQimGe2sHqHh0Dd6CmzaJbVp4d6ziugG1GM1lcAGKDzbJwkhlElXBLu-SxPfmbAT0H0dUDL9OEj_FVqnWyrC8 Jul 29 05:28:02.582420 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Id: None Jul 29 05:28:02.582420 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Name: None Jul 29 05:28:02.582420 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Identity-Status: Confirmed Jul 29 05:28:02.582420 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Is-Admin-Project: True Jul 29 05:28:02.582420 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Id: default Jul 29 05:28:02.582420 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Name: Default Jul 29 05:28:02.582420 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Id: 92f16adc2357459aa0afb68db89031dd Jul 29 05:28:02.582420 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Name: tempest-AttachVolumeTestJSON-1982834268 Jul 29 05:28:02.582420 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Role: member,reader Jul 29 05:28:02.582420 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Roles: member,reader Jul 29 05:28:02.585316 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/92f16adc2357459aa0afb68db89031dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/92f16adc2357459aa0afb68db89031dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_92f16adc2357459aa0afb68db89031dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/92f16adc2357459aa0afb68db89031dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:28:02.585316 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant: tempest-AttachVolumeTestJSON-1982834268 Jul 29 05:28:02.585316 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Id: 92f16adc2357459aa0afb68db89031dd Jul 29 05:28:02.585316 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1982834268 Jul 29 05:28:02.585316 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User: tempest-AttachVolumeTestJSON-1982834268-project Jul 29 05:28:02.585316 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Id: default Jul 29 05:28:02.585316 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Name: Default Jul 29 05:28:02.585316 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Id: c2db6ada97da4ee89f3ce8de98f2653a Jul 29 05:28:02.585316 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Name: tempest-AttachVolumeTestJSON-1982834268-project Jul 29 05:28:02.585316 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: method: > Jul 29 05:28:02.585316 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: exception: Instance 62613145-ee65-4472-a5f6-23a6d76ea1b9 could not be found. Jul 29 05:28:02.585316 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: action_args: {'id': '62613145-ee65-4472-a5f6-23a6d76ea1b9'} Jul 29 05:28:02.586766 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:28:02.586766 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:02.586766 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:28:02.586766 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:28:02.586766 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:28:02.586766 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:28:02.586766 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:28:02.586766 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:28:02.586766 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:28:02.586766 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:28:02.586766 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62613145-ee65-4472-a5f6-23a6d76ea1b9 could not be found. Jul 29 05:28:02.586766 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:02.586766 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:28:02.586766 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:02.586766 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:02.586766 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:28:02.586766 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:28:02.586766 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:28:02.586766 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:28:02.586766 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:28:02.589617 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:28:02.589617 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:28:02.589617 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:28:02.589617 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:28:02.589617 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:28:02.589617 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:28:02.589617 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:28:02.589617 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62613145-ee65-4472-a5f6-23a6d76ea1b9 could not be found. Jul 29 05:28:02.589617 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:02.589617 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:28:02.589617 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:02.589617 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:02.589617 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:28:02.589617 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:28:02.589617 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:28:02.589617 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:28:02.589617 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62613145-ee65-4472-a5f6-23a6d76ea1b9 could not be found. Jul 29 05:28:02.589617 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:02.592619 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-0c441a7a-0a9b-4613-988f-43179fa516a4 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Returning 404 to user: Instance 62613145-ee65-4472-a5f6-23a6d76ea1b9 could not be found. {{(pid=117820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:28:02.592619 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-0c441a7a-0a9b-4613-988f-43179fa516a4 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9" status: 404 len: 111 microversion: 2.1 time: 0.036772 Jul 29 05:28:02.592619 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 442/928] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:28:02 2022] GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:28:02.598364 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-21f490b1-7159-4148-8605-46ad3b78059e tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '.version_select at 0x7fa6414bdca0>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:02.622399 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-21f490b1-7159-4148-8605-46ad3b78059e tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1200714588" status: 202 len: 0 microversion: 2.1 time: 0.031067 Jul 29 05:28:02.623713 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 487/929] 10.222.0.49 () {58 vars in 1221 bytes} [Fri Jul 29 05:28:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1200714588 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 29 05:28:03.105714 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-fef7760e-174b-4479-9faa-c46fc77c4858 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:03.108208 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-fef7760e-174b-4479-9faa-c46fc77c4858 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:03.117764 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-fef7760e-174b-4479-9faa-c46fc77c4858 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:03.118513 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-fef7760e-174b-4479-9faa-c46fc77c4858 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:03.119530 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-fef7760e-174b-4479-9faa-c46fc77c4858 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:03.120121 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-fef7760e-174b-4479-9faa-c46fc77c4858 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:03.408206 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-13dccb66-2410-4e6f-947c-7f4638688c54 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:03.409275 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-13dccb66-2410-4e6f-947c-7f4638688c54 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:03.420359 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:28:03.438445 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-fef7760e-174b-4479-9faa-c46fc77c4858 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:03.447172 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-fef7760e-174b-4479-9faa-c46fc77c4858 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:03.449068 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-fef7760e-174b-4479-9faa-c46fc77c4858 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:03.450880 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-fef7760e-174b-4479-9faa-c46fc77c4858 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1729 microversion: 2.20 time: 0.353744 Jul 29 05:28:03.467090 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-13dccb66-2410-4e6f-947c-7f4638688c54 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:03.467090 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-13dccb66-2410-4e6f-947c-7f4638688c54 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:03.467090 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-13dccb66-2410-4e6f-947c-7f4638688c54 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:03.467090 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-13dccb66-2410-4e6f-947c-7f4638688c54 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:03.468978 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 443/930] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:28:03 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1729 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:28:03.801528 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-13dccb66-2410-4e6f-947c-7f4638688c54 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:03.814316 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-13dccb66-2410-4e6f-947c-7f4638688c54 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1755 microversion: 2.1 time: 0.413065 Jul 29 05:28:03.815386 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 488/931] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:28:03 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1755 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:28:04.475115 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-f3f3752e-bd32-48a6-8a6e-655bb1d10edb tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:04.475756 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-f3f3752e-bd32-48a6-8a6e-655bb1d10edb tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:04.483699 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f3f3752e-bd32-48a6-8a6e-655bb1d10edb tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:04.484422 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f3f3752e-bd32-48a6-8a6e-655bb1d10edb tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:04.485247 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f3f3752e-bd32-48a6-8a6e-655bb1d10edb tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:04.485693 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f3f3752e-bd32-48a6-8a6e-655bb1d10edb tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:04.645145 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-f3f3752e-bd32-48a6-8a6e-655bb1d10edb tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:04.653582 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-f3f3752e-bd32-48a6-8a6e-655bb1d10edb tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:04.655293 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-f3f3752e-bd32-48a6-8a6e-655bb1d10edb tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:04.656513 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-f3f3752e-bd32-48a6-8a6e-655bb1d10edb tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1729 microversion: 2.20 time: 0.185474 Jul 29 05:28:04.657069 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 444/932] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:28:04 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1729 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:28:04.850145 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-6ab403ab-c85d-4ac9-8068-d8c113dde2af tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:04.850839 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-6ab403ab-c85d-4ac9-8068-d8c113dde2af tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:04.857306 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6ab403ab-c85d-4ac9-8068-d8c113dde2af tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:04.857705 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6ab403ab-c85d-4ac9-8068-d8c113dde2af tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:04.858480 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6ab403ab-c85d-4ac9-8068-d8c113dde2af tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:04.858914 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6ab403ab-c85d-4ac9-8068-d8c113dde2af tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:05.012025 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-759e0512-6c81-496e-ab2b-7c591a7c62bc req-035d4e1e-5452-45a3-9b1a-1856a15901f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e3305fc-3d92-4d3f-afb8-c25395280792", "name": "network-vif-plugged", "status": "completed", "tag": "6f412c06-c9c0-4423-b60d-0b7fa2c32b6f"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:28:05.036239 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-759e0512-6c81-496e-ab2b-7c591a7c62bc req-035d4e1e-5452-45a3-9b1a-1856a15901f2 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:05.037406 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-759e0512-6c81-496e-ab2b-7c591a7c62bc req-035d4e1e-5452-45a3-9b1a-1856a15901f2 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:05.052919 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-759e0512-6c81-496e-ab2b-7c591a7c62bc req-035d4e1e-5452-45a3-9b1a-1856a15901f2 service nova] Creating event network-vif-plugged:6f412c06-c9c0-4423-b60d-0b7fa2c32b6f for instance 1e3305fc-3d92-4d3f-afb8-c25395280792 on hv-cinder-85127 Jul 29 05:28:05.073766 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-759e0512-6c81-496e-ab2b-7c591a7c62bc req-035d4e1e-5452-45a3-9b1a-1856a15901f2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066666 Jul 29 05:28:05.075149 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 445/933] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:28:05.083421 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-6ab403ab-c85d-4ac9-8068-d8c113dde2af tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:05.106811 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-6ab403ab-c85d-4ac9-8068-d8c113dde2af tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1755 microversion: 2.1 time: 0.260233 Jul 29 05:28:05.110356 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 489/934] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:28:04 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1755 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:28:05.681324 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-bfc3b42a-17f5-48dc-bae8-ea599f308a7c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:05.682030 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-bfc3b42a-17f5-48dc-bae8-ea599f308a7c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:05.690085 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bfc3b42a-17f5-48dc-bae8-ea599f308a7c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:05.690759 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bfc3b42a-17f5-48dc-bae8-ea599f308a7c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:05.691986 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bfc3b42a-17f5-48dc-bae8-ea599f308a7c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:05.692852 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bfc3b42a-17f5-48dc-bae8-ea599f308a7c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:05.869222 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-bfc3b42a-17f5-48dc-bae8-ea599f308a7c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:05.882006 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-bfc3b42a-17f5-48dc-bae8-ea599f308a7c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:05.883797 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-bfc3b42a-17f5-48dc-bae8-ea599f308a7c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:05.885267 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-bfc3b42a-17f5-48dc-bae8-ea599f308a7c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1729 microversion: 2.20 time: 0.208837 Jul 29 05:28:05.885831 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 446/935] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:28:05 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1729 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:28:06.134419 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-c970431a-1363-4051-bccd-96b6c7b534a5 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:06.135259 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-c970431a-1363-4051-bccd-96b6c7b534a5 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:06.142340 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c970431a-1363-4051-bccd-96b6c7b534a5 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:06.142799 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c970431a-1363-4051-bccd-96b6c7b534a5 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:06.143632 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c970431a-1363-4051-bccd-96b6c7b534a5 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:06.144074 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c970431a-1363-4051-bccd-96b6c7b534a5 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:06.194025 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-6569cc8b-a6c3-4b43-b73d-f05ad7379148 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:06.194564 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-6569cc8b-a6c3-4b43-b73d-f05ad7379148 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:06.203124 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6569cc8b-a6c3-4b43-b73d-f05ad7379148 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:06.203727 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6569cc8b-a6c3-4b43-b73d-f05ad7379148 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:06.204748 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6569cc8b-a6c3-4b43-b73d-f05ad7379148 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:06.205321 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6569cc8b-a6c3-4b43-b73d-f05ad7379148 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:06.224242 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.wsgi [None req-6569cc8b-a6c3-4b43-b73d-f05ad7379148 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] HTTP exception thrown: Instance 62613145-ee65-4472-a5f6-23a6d76ea1b9 could not be found. Jul 29 05:28:06.226008 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-6569cc8b-a6c3-4b43-b73d-f05ad7379148 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Request method failure captured: Jul 29 05:28:06.226008 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: request: DELETE /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9 HTTP/1.1 Jul 29 05:28:06.226008 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept: application/json Jul 29 05:28:06.226008 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept-Encoding: identity Jul 29 05:28:06.226008 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Connection: close Jul 29 05:28:06.226008 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Length: 0 Jul 29 05:28:06.226008 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Type: application/json Jul 29 05:28:06.226008 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Host: 10.222.0.49 Jul 29 05:28:06.226008 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Openstack-System-Scope: None Jul 29 05:28:06.226008 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: User-Agent: python-urllib3/1.26.10 Jul 29 05:28:06.226008 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Auth-Token: gAAAAABi425XzClJm-mqNh7trJiRa8zhb1JdfD6kuObTAyJnIB1UhZxLI0lbverA-I-cqLqY2-6zazXj0ABWM0tRJVMiiwcj6fNQimGe2sHqHh0Dd6CmzaJbVp4d6ziugG1GM1lcAGKDzbJwkhlElXBLu-SxPfmbAT0H0dUDL9OEj_FVqnWyrC8 Jul 29 05:28:06.226008 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Id: None Jul 29 05:28:06.226008 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Name: None Jul 29 05:28:06.226008 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Identity-Status: Confirmed Jul 29 05:28:06.226008 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Is-Admin-Project: True Jul 29 05:28:06.226008 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Id: default Jul 29 05:28:06.226008 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Name: Default Jul 29 05:28:06.226008 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Id: 92f16adc2357459aa0afb68db89031dd Jul 29 05:28:06.226008 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Name: tempest-AttachVolumeTestJSON-1982834268 Jul 29 05:28:06.226008 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Role: member,reader Jul 29 05:28:06.226008 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Roles: member,reader Jul 29 05:28:06.227639 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/92f16adc2357459aa0afb68db89031dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/92f16adc2357459aa0afb68db89031dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_92f16adc2357459aa0afb68db89031dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/92f16adc2357459aa0afb68db89031dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:28:06.227639 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant: tempest-AttachVolumeTestJSON-1982834268 Jul 29 05:28:06.227639 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Id: 92f16adc2357459aa0afb68db89031dd Jul 29 05:28:06.227639 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1982834268 Jul 29 05:28:06.227639 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User: tempest-AttachVolumeTestJSON-1982834268-project Jul 29 05:28:06.227639 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Id: default Jul 29 05:28:06.227639 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Name: Default Jul 29 05:28:06.227639 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Id: c2db6ada97da4ee89f3ce8de98f2653a Jul 29 05:28:06.227639 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Name: tempest-AttachVolumeTestJSON-1982834268-project Jul 29 05:28:06.227639 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: method: > Jul 29 05:28:06.227639 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: exception: Instance 62613145-ee65-4472-a5f6-23a6d76ea1b9 could not be found. Jul 29 05:28:06.227639 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: action_args: {'id': '62613145-ee65-4472-a5f6-23a6d76ea1b9'} Jul 29 05:28:06.229049 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:28:06.229049 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:06.229049 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:28:06.229049 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:28:06.229049 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:28:06.229049 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:28:06.229049 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:28:06.229049 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:28:06.229049 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:28:06.229049 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:28:06.229049 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62613145-ee65-4472-a5f6-23a6d76ea1b9 could not be found. Jul 29 05:28:06.229049 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:06.229049 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:28:06.229049 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:06.229049 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:06.229049 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:28:06.229049 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:28:06.229049 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:28:06.229049 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:28:06.229049 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:28:06.230630 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:28:06.230630 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 05:28:06.230630 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 05:28:06.230630 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 05:28:06.230630 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 05:28:06.230630 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:28:06.230630 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:28:06.230630 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:28:06.230630 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:28:06.230630 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62613145-ee65-4472-a5f6-23a6d76ea1b9 could not be found. Jul 29 05:28:06.230630 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:06.230630 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:28:06.230630 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:06.230630 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:06.230630 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:28:06.230630 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:28:06.230630 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:28:06.230630 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:28:06.230630 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62613145-ee65-4472-a5f6-23a6d76ea1b9 could not be found. Jul 29 05:28:06.230630 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:06.235661 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-6569cc8b-a6c3-4b43-b73d-f05ad7379148 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Returning 404 to user: Instance 62613145-ee65-4472-a5f6-23a6d76ea1b9 could not be found. {{(pid=117820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:28:06.235661 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-6569cc8b-a6c3-4b43-b73d-f05ad7379148 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "DELETE /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9" status: 404 len: 111 microversion: 2.1 time: 0.037725 Jul 29 05:28:06.235661 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 447/936] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 05:28:06 2022] DELETE /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:28:06.238706 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-56cb9dff-8826-45e8-b08c-32a110c36932 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:06.239558 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-56cb9dff-8826-45e8-b08c-32a110c36932 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: 62613145-ee65-4472-a5f6-23a6d76ea1b9] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:06.246964 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-56cb9dff-8826-45e8-b08c-32a110c36932 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:06.247627 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-56cb9dff-8826-45e8-b08c-32a110c36932 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:06.249498 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-56cb9dff-8826-45e8-b08c-32a110c36932 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:06.249966 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-56cb9dff-8826-45e8-b08c-32a110c36932 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:06.267451 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.wsgi [None req-56cb9dff-8826-45e8-b08c-32a110c36932 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] HTTP exception thrown: Instance 62613145-ee65-4472-a5f6-23a6d76ea1b9 could not be found. Jul 29 05:28:06.269172 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-56cb9dff-8826-45e8-b08c-32a110c36932 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Request method failure captured: Jul 29 05:28:06.269172 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: request: GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9 HTTP/1.1 Jul 29 05:28:06.269172 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept: application/json Jul 29 05:28:06.269172 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept-Encoding: identity Jul 29 05:28:06.269172 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Connection: close Jul 29 05:28:06.269172 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Length: 0 Jul 29 05:28:06.269172 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Type: application/json Jul 29 05:28:06.269172 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Host: 10.222.0.49 Jul 29 05:28:06.269172 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Openstack-System-Scope: None Jul 29 05:28:06.269172 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: User-Agent: python-urllib3/1.26.10 Jul 29 05:28:06.269172 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Auth-Token: gAAAAABi425XzClJm-mqNh7trJiRa8zhb1JdfD6kuObTAyJnIB1UhZxLI0lbverA-I-cqLqY2-6zazXj0ABWM0tRJVMiiwcj6fNQimGe2sHqHh0Dd6CmzaJbVp4d6ziugG1GM1lcAGKDzbJwkhlElXBLu-SxPfmbAT0H0dUDL9OEj_FVqnWyrC8 Jul 29 05:28:06.269172 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Id: None Jul 29 05:28:06.269172 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Name: None Jul 29 05:28:06.269172 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Identity-Status: Confirmed Jul 29 05:28:06.269172 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Is-Admin-Project: True Jul 29 05:28:06.269172 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Id: default Jul 29 05:28:06.269172 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Name: Default Jul 29 05:28:06.269172 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Id: 92f16adc2357459aa0afb68db89031dd Jul 29 05:28:06.269172 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Name: tempest-AttachVolumeTestJSON-1982834268 Jul 29 05:28:06.269172 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Role: member,reader Jul 29 05:28:06.269172 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Roles: member,reader Jul 29 05:28:06.270786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/92f16adc2357459aa0afb68db89031dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/92f16adc2357459aa0afb68db89031dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_92f16adc2357459aa0afb68db89031dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/92f16adc2357459aa0afb68db89031dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:28:06.270786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant: tempest-AttachVolumeTestJSON-1982834268 Jul 29 05:28:06.270786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Id: 92f16adc2357459aa0afb68db89031dd Jul 29 05:28:06.270786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1982834268 Jul 29 05:28:06.270786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User: tempest-AttachVolumeTestJSON-1982834268-project Jul 29 05:28:06.270786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Id: default Jul 29 05:28:06.270786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Name: Default Jul 29 05:28:06.270786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Id: c2db6ada97da4ee89f3ce8de98f2653a Jul 29 05:28:06.270786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Name: tempest-AttachVolumeTestJSON-1982834268-project Jul 29 05:28:06.270786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: method: > Jul 29 05:28:06.270786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: exception: Instance 62613145-ee65-4472-a5f6-23a6d76ea1b9 could not be found. Jul 29 05:28:06.270786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: action_args: {'id': '62613145-ee65-4472-a5f6-23a6d76ea1b9'} Jul 29 05:28:06.271632 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:28:06.271632 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:06.271632 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:28:06.271632 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:28:06.271632 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:28:06.271632 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:28:06.271632 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:28:06.271632 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:28:06.271632 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:28:06.271632 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:28:06.271632 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62613145-ee65-4472-a5f6-23a6d76ea1b9 could not be found. Jul 29 05:28:06.271632 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:06.271632 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:28:06.271632 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:06.271632 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:06.271632 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:28:06.271632 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:28:06.271632 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:28:06.271632 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:28:06.271632 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:28:06.277389 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:28:06.277389 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:28:06.277389 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:28:06.277389 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:28:06.277389 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:28:06.277389 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:28:06.277389 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:28:06.277389 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62613145-ee65-4472-a5f6-23a6d76ea1b9 could not be found. Jul 29 05:28:06.277389 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:06.277389 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:28:06.277389 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:06.277389 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:06.277389 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:28:06.277389 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:28:06.277389 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:28:06.277389 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:28:06.277389 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62613145-ee65-4472-a5f6-23a6d76ea1b9 could not be found. Jul 29 05:28:06.277389 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:06.278850 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-56cb9dff-8826-45e8-b08c-32a110c36932 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Returning 404 to user: Instance 62613145-ee65-4472-a5f6-23a6d76ea1b9 could not be found. {{(pid=117820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:28:06.278850 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-56cb9dff-8826-45e8-b08c-32a110c36932 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9" status: 404 len: 111 microversion: 2.1 time: 0.036279 Jul 29 05:28:06.278850 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 448/937] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:28:06 2022] GET /compute/v2.1/servers/62613145-ee65-4472-a5f6-23a6d76ea1b9 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:28:06.375045 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-c970431a-1363-4051-bccd-96b6c7b534a5 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:06.391399 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-c970431a-1363-4051-bccd-96b6c7b534a5 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1755 microversion: 2.1 time: 0.260971 Jul 29 05:28:06.391946 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 490/938] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:28:06 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1755 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:28:06.921934 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-4b5f05f7-7931-4588-b4fa-018f8c19ae40 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:06.922630 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-4b5f05f7-7931-4588-b4fa-018f8c19ae40 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:06.931783 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-4b5f05f7-7931-4588-b4fa-018f8c19ae40 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:06.932321 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-4b5f05f7-7931-4588-b4fa-018f8c19ae40 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:06.933144 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-4b5f05f7-7931-4588-b4fa-018f8c19ae40 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:06.933861 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-4b5f05f7-7931-4588-b4fa-018f8c19ae40 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:07.125638 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-4b5f05f7-7931-4588-b4fa-018f8c19ae40 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:07.136804 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-4b5f05f7-7931-4588-b4fa-018f8c19ae40 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:07.139083 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-4b5f05f7-7931-4588-b4fa-018f8c19ae40 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:07.140640 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-4b5f05f7-7931-4588-b4fa-018f8c19ae40 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1729 microversion: 2.20 time: 0.223820 Jul 29 05:28:07.157368 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 449/939] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:28:06 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1729 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:28:07.425284 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-3ad82669-0f15-4769-a473-2a316d023e40 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:07.426127 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-3ad82669-0f15-4769-a473-2a316d023e40 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:07.435062 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3ad82669-0f15-4769-a473-2a316d023e40 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:07.436170 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3ad82669-0f15-4769-a473-2a316d023e40 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:07.437005 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3ad82669-0f15-4769-a473-2a316d023e40 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:07.437446 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3ad82669-0f15-4769-a473-2a316d023e40 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:07.458042 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell1:SELECT=100 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:28:07.476666 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-df14943e-3e09-4c01-bb74-f6ab325109b7 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:07.477695 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-df14943e-3e09-4c01-bb74-f6ab325109b7 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:07.485283 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-df14943e-3e09-4c01-bb74-f6ab325109b7 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:07.485938 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-df14943e-3e09-4c01-bb74-f6ab325109b7 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:07.487823 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-df14943e-3e09-4c01-bb74-f6ab325109b7 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:07.488718 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-df14943e-3e09-4c01-bb74-f6ab325109b7 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:07.516941 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.wsgi [None req-df14943e-3e09-4c01-bb74-f6ab325109b7 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] HTTP exception thrown: Instance f6ff83e9-b98e-47c5-83cb-37ac61826fba could not be found. Jul 29 05:28:07.518804 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-df14943e-3e09-4c01-bb74-f6ab325109b7 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Request method failure captured: Jul 29 05:28:07.518804 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: request: DELETE /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba HTTP/1.1 Jul 29 05:28:07.518804 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept: application/json Jul 29 05:28:07.518804 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept-Encoding: identity Jul 29 05:28:07.518804 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Connection: close Jul 29 05:28:07.518804 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Length: 0 Jul 29 05:28:07.518804 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Type: application/json Jul 29 05:28:07.518804 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Host: 10.222.0.49 Jul 29 05:28:07.518804 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Openstack-System-Scope: None Jul 29 05:28:07.518804 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: User-Agent: python-urllib3/1.26.10 Jul 29 05:28:07.518804 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Auth-Token: gAAAAABi425XzClJm-mqNh7trJiRa8zhb1JdfD6kuObTAyJnIB1UhZxLI0lbverA-I-cqLqY2-6zazXj0ABWM0tRJVMiiwcj6fNQimGe2sHqHh0Dd6CmzaJbVp4d6ziugG1GM1lcAGKDzbJwkhlElXBLu-SxPfmbAT0H0dUDL9OEj_FVqnWyrC8 Jul 29 05:28:07.518804 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Id: None Jul 29 05:28:07.518804 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Name: None Jul 29 05:28:07.518804 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Identity-Status: Confirmed Jul 29 05:28:07.518804 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Is-Admin-Project: True Jul 29 05:28:07.518804 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Id: default Jul 29 05:28:07.518804 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Name: Default Jul 29 05:28:07.518804 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Id: 92f16adc2357459aa0afb68db89031dd Jul 29 05:28:07.518804 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Name: tempest-AttachVolumeTestJSON-1982834268 Jul 29 05:28:07.518804 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Role: member,reader Jul 29 05:28:07.518804 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Roles: member,reader Jul 29 05:28:07.520425 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/92f16adc2357459aa0afb68db89031dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/92f16adc2357459aa0afb68db89031dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_92f16adc2357459aa0afb68db89031dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/92f16adc2357459aa0afb68db89031dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:28:07.520425 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant: tempest-AttachVolumeTestJSON-1982834268 Jul 29 05:28:07.520425 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Id: 92f16adc2357459aa0afb68db89031dd Jul 29 05:28:07.520425 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1982834268 Jul 29 05:28:07.520425 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User: tempest-AttachVolumeTestJSON-1982834268-project Jul 29 05:28:07.520425 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Id: default Jul 29 05:28:07.520425 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Name: Default Jul 29 05:28:07.520425 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Id: c2db6ada97da4ee89f3ce8de98f2653a Jul 29 05:28:07.520425 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Name: tempest-AttachVolumeTestJSON-1982834268-project Jul 29 05:28:07.520425 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: method: > Jul 29 05:28:07.520425 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: exception: Instance f6ff83e9-b98e-47c5-83cb-37ac61826fba could not be found. Jul 29 05:28:07.520425 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: action_args: {'id': 'f6ff83e9-b98e-47c5-83cb-37ac61826fba'} Jul 29 05:28:07.521240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:28:07.521240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:07.521240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:28:07.521240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:28:07.521240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:28:07.521240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:28:07.521240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:28:07.521240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:28:07.521240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:28:07.521240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:28:07.521240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6ff83e9-b98e-47c5-83cb-37ac61826fba could not be found. Jul 29 05:28:07.521240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:07.521240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:28:07.521240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:07.521240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:07.521240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:28:07.521240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:28:07.521240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:28:07.521240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:28:07.521240 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:28:07.522593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:28:07.522593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 05:28:07.522593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 05:28:07.522593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 05:28:07.522593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 05:28:07.522593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:28:07.522593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:28:07.522593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:28:07.522593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:28:07.522593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6ff83e9-b98e-47c5-83cb-37ac61826fba could not be found. Jul 29 05:28:07.522593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:07.522593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:28:07.522593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:07.522593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:07.522593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:28:07.522593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:28:07.522593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:28:07.522593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:28:07.522593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6ff83e9-b98e-47c5-83cb-37ac61826fba could not be found. Jul 29 05:28:07.522593 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:07.525162 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-df14943e-3e09-4c01-bb74-f6ab325109b7 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Returning 404 to user: Instance f6ff83e9-b98e-47c5-83cb-37ac61826fba could not be found. {{(pid=117820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:28:07.526483 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-df14943e-3e09-4c01-bb74-f6ab325109b7 tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 404 len: 111 microversion: 2.1 time: 0.053698 Jul 29 05:28:07.527195 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 450/940] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 05:28:07 2022] DELETE /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 05:28:07.537309 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-2b99b354-27e7-4d44-b18f-d9dcc36398df tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:07.538303 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-2b99b354-27e7-4d44-b18f-d9dcc36398df tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] [instance: f6ff83e9-b98e-47c5-83cb-37ac61826fba] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:07.545742 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2b99b354-27e7-4d44-b18f-d9dcc36398df tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:07.546739 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2b99b354-27e7-4d44-b18f-d9dcc36398df tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:07.547930 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2b99b354-27e7-4d44-b18f-d9dcc36398df tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:07.548643 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-2b99b354-27e7-4d44-b18f-d9dcc36398df tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:07.573648 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.wsgi [None req-2b99b354-27e7-4d44-b18f-d9dcc36398df tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] HTTP exception thrown: Instance f6ff83e9-b98e-47c5-83cb-37ac61826fba could not be found. Jul 29 05:28:07.576956 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-2b99b354-27e7-4d44-b18f-d9dcc36398df tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Request method failure captured: Jul 29 05:28:07.576956 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: request: GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba HTTP/1.1 Jul 29 05:28:07.576956 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept: application/json Jul 29 05:28:07.576956 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept-Encoding: identity Jul 29 05:28:07.576956 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Connection: close Jul 29 05:28:07.576956 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Length: 0 Jul 29 05:28:07.576956 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Type: application/json Jul 29 05:28:07.576956 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Host: 10.222.0.49 Jul 29 05:28:07.576956 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Openstack-System-Scope: None Jul 29 05:28:07.576956 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: User-Agent: python-urllib3/1.26.10 Jul 29 05:28:07.576956 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Auth-Token: gAAAAABi425XzClJm-mqNh7trJiRa8zhb1JdfD6kuObTAyJnIB1UhZxLI0lbverA-I-cqLqY2-6zazXj0ABWM0tRJVMiiwcj6fNQimGe2sHqHh0Dd6CmzaJbVp4d6ziugG1GM1lcAGKDzbJwkhlElXBLu-SxPfmbAT0H0dUDL9OEj_FVqnWyrC8 Jul 29 05:28:07.576956 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Id: None Jul 29 05:28:07.576956 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Name: None Jul 29 05:28:07.576956 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Identity-Status: Confirmed Jul 29 05:28:07.576956 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Is-Admin-Project: True Jul 29 05:28:07.576956 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Id: default Jul 29 05:28:07.576956 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Name: Default Jul 29 05:28:07.576956 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Id: 92f16adc2357459aa0afb68db89031dd Jul 29 05:28:07.576956 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Name: tempest-AttachVolumeTestJSON-1982834268 Jul 29 05:28:07.576956 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Role: member,reader Jul 29 05:28:07.576956 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Roles: member,reader Jul 29 05:28:07.578321 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/92f16adc2357459aa0afb68db89031dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/92f16adc2357459aa0afb68db89031dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_92f16adc2357459aa0afb68db89031dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/92f16adc2357459aa0afb68db89031dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:28:07.578321 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant: tempest-AttachVolumeTestJSON-1982834268 Jul 29 05:28:07.578321 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Id: 92f16adc2357459aa0afb68db89031dd Jul 29 05:28:07.578321 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1982834268 Jul 29 05:28:07.578321 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User: tempest-AttachVolumeTestJSON-1982834268-project Jul 29 05:28:07.578321 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Id: default Jul 29 05:28:07.578321 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Name: Default Jul 29 05:28:07.578321 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Id: c2db6ada97da4ee89f3ce8de98f2653a Jul 29 05:28:07.578321 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Name: tempest-AttachVolumeTestJSON-1982834268-project Jul 29 05:28:07.578321 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: method: > Jul 29 05:28:07.578321 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: exception: Instance f6ff83e9-b98e-47c5-83cb-37ac61826fba could not be found. Jul 29 05:28:07.578321 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: action_args: {'id': 'f6ff83e9-b98e-47c5-83cb-37ac61826fba'} Jul 29 05:28:07.579064 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:28:07.579064 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:07.579064 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:28:07.579064 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:28:07.579064 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:28:07.579064 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:28:07.579064 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:28:07.579064 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:28:07.579064 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:28:07.579064 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:28:07.579064 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6ff83e9-b98e-47c5-83cb-37ac61826fba could not be found. Jul 29 05:28:07.579064 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:07.579064 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:28:07.579064 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:07.579064 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:07.579064 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:28:07.579064 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:28:07.579064 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:28:07.579064 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:28:07.579064 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:28:07.580301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:28:07.580301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:28:07.580301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:28:07.580301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:28:07.580301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:28:07.580301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:28:07.580301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:28:07.580301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6ff83e9-b98e-47c5-83cb-37ac61826fba could not be found. Jul 29 05:28:07.580301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:07.580301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:28:07.580301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:07.580301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:07.580301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:28:07.580301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:28:07.580301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:28:07.580301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:28:07.580301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6ff83e9-b98e-47c5-83cb-37ac61826fba could not be found. Jul 29 05:28:07.580301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:07.583266 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-2b99b354-27e7-4d44-b18f-d9dcc36398df tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] Returning 404 to user: Instance f6ff83e9-b98e-47c5-83cb-37ac61826fba could not be found. {{(pid=117820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:28:07.585099 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-2b99b354-27e7-4d44-b18f-d9dcc36398df tempest-AttachVolumeTestJSON-1982834268 tempest-AttachVolumeTestJSON-1982834268-project] 10.222.0.49 "GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba" status: 404 len: 111 microversion: 2.1 time: 0.052183 Jul 29 05:28:07.590306 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 451/941] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:28:07 2022] GET /compute/v2.1/servers/f6ff83e9-b98e-47c5-83cb-37ac61826fba => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:28:07.672821 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-3ad82669-0f15-4769-a473-2a316d023e40 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:07.686285 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-3ad82669-0f15-4769-a473-2a316d023e40 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1755 microversion: 2.1 time: 0.266045 Jul 29 05:28:07.687625 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 491/942] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:28:07 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1755 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:28:08.171592 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-f5c175fa-bd9c-4776-96f0-17e203af5e13 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:08.172361 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-f5c175fa-bd9c-4776-96f0-17e203af5e13 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:08.182552 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f5c175fa-bd9c-4776-96f0-17e203af5e13 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:08.183001 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f5c175fa-bd9c-4776-96f0-17e203af5e13 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:08.183833 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f5c175fa-bd9c-4776-96f0-17e203af5e13 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:08.184252 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f5c175fa-bd9c-4776-96f0-17e203af5e13 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:08.563395 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-f5c175fa-bd9c-4776-96f0-17e203af5e13 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:08.573202 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-f5c175fa-bd9c-4776-96f0-17e203af5e13 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:08.574731 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-f5c175fa-bd9c-4776-96f0-17e203af5e13 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:08.576929 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-f5c175fa-bd9c-4776-96f0-17e203af5e13 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1716 microversion: 2.20 time: 0.414638 Jul 29 05:28:08.577488 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 452/943] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:28:08 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1716 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:28:08.711799 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-5b20448a-1704-4ef4-a423-c1a94ca1fe39 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:08.712721 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-5b20448a-1704-4ef4-a423-c1a94ca1fe39 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:08.723603 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5b20448a-1704-4ef4-a423-c1a94ca1fe39 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:08.724160 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5b20448a-1704-4ef4-a423-c1a94ca1fe39 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:08.725230 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5b20448a-1704-4ef4-a423-c1a94ca1fe39 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:08.725952 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5b20448a-1704-4ef4-a423-c1a94ca1fe39 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:09.272016 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-5b20448a-1704-4ef4-a423-c1a94ca1fe39 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:09.286719 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-5b20448a-1704-4ef4-a423-c1a94ca1fe39 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1755 microversion: 2.1 time: 0.581184 Jul 29 05:28:09.287710 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 492/944] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:28:08 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1755 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:28:10.177771 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-da4566dc-3bd2-43b2-84ee-9f7ac381f684 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:10.179069 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-da4566dc-3bd2-43b2-84ee-9f7ac381f684 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: c7d28599-67a9-4e84-a44d-79f1a6bf728f] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:10.187207 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:28:10.189195 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-da4566dc-3bd2-43b2-84ee-9f7ac381f684 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:10.189860 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-da4566dc-3bd2-43b2-84ee-9f7ac381f684 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:10.190924 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-da4566dc-3bd2-43b2-84ee-9f7ac381f684 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:10.191719 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-da4566dc-3bd2-43b2-84ee-9f7ac381f684 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:10.321408 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-ccfebc3d-7a2e-43fb-8a12-b91ae2a10c57 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:10.322553 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-ccfebc3d-7a2e-43fb-8a12-b91ae2a10c57 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:10.328895 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.objects.instance [None req-da4566dc-3bd2-43b2-84ee-9f7ac381f684 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lazy-loading 'services' on Instance uuid c7d28599-67a9-4e84-a44d-79f1a6bf728f {{(pid=117820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:28:10.346354 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ccfebc3d-7a2e-43fb-8a12-b91ae2a10c57 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:10.347202 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ccfebc3d-7a2e-43fb-8a12-b91ae2a10c57 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:10.351250 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ccfebc3d-7a2e-43fb-8a12-b91ae2a10c57 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:10.352306 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ccfebc3d-7a2e-43fb-8a12-b91ae2a10c57 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:10.478924 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-da4566dc-3bd2-43b2-84ee-9f7ac381f684 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f/os-volume_attachments/363fc012-36fa-44e7-bafa-fbf1643b6ea9" status: 202 len: 0 microversion: 2.1 time: 0.304376 Jul 29 05:28:10.485449 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 453/945] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Jul 29 05:28:10 2022] DELETE /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f/os-volume_attachments/363fc012-36fa-44e7-bafa-fbf1643b6ea9 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 05:28:10.493011 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-4e38995e-c66f-4873-aae2-596561b7b31c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:10.496314 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-4e38995e-c66f-4873-aae2-596561b7b31c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: c7d28599-67a9-4e84-a44d-79f1a6bf728f] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:10.513951 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-4e38995e-c66f-4873-aae2-596561b7b31c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:10.514843 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-4e38995e-c66f-4873-aae2-596561b7b31c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:10.516890 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-4e38995e-c66f-4873-aae2-596561b7b31c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:10.519622 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-4e38995e-c66f-4873-aae2-596561b7b31c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:10.594692 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-4e38995e-c66f-4873-aae2-596561b7b31c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099355 Jul 29 05:28:10.603109 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 454/946] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:28:10 2022] GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:28:10.833808 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-ccfebc3d-7a2e-43fb-8a12-b91ae2a10c57 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:10.851776 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-ccfebc3d-7a2e-43fb-8a12-b91ae2a10c57 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1755 microversion: 2.1 time: 0.538444 Jul 29 05:28:10.852820 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 493/947] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:28:10 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1755 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:28:11.628705 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-a39a1d10-4166-423f-9d23-aa32caf787f0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:11.643748 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-a39a1d10-4166-423f-9d23-aa32caf787f0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: c7d28599-67a9-4e84-a44d-79f1a6bf728f] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:11.677098 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a39a1d10-4166-423f-9d23-aa32caf787f0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:11.679202 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a39a1d10-4166-423f-9d23-aa32caf787f0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:11.680934 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a39a1d10-4166-423f-9d23-aa32caf787f0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:11.681952 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a39a1d10-4166-423f-9d23-aa32caf787f0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:11.777099 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-a39a1d10-4166-423f-9d23-aa32caf787f0 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.169756 Jul 29 05:28:11.779378 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 455/948] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:28:11 2022] GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f/os-volume_attachments => generated 25 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 05:28:11.914755 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-7b75a216-0b1b-44a6-abe8-00e74804ed98 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:11.914755 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-7b75a216-0b1b-44a6-abe8-00e74804ed98 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:11.937295 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7b75a216-0b1b-44a6-abe8-00e74804ed98 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:11.937295 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7b75a216-0b1b-44a6-abe8-00e74804ed98 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:11.938143 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7b75a216-0b1b-44a6-abe8-00e74804ed98 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:11.938492 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-f8180dc6-12d5-4cc0-ae88-cfc2bab39db9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:11.938674 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7b75a216-0b1b-44a6-abe8-00e74804ed98 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:11.939596 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-f8180dc6-12d5-4cc0-ae88-cfc2bab39db9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: c7d28599-67a9-4e84-a44d-79f1a6bf728f] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:11.965107 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f8180dc6-12d5-4cc0-ae88-cfc2bab39db9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:11.965902 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f8180dc6-12d5-4cc0-ae88-cfc2bab39db9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:11.979503 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f8180dc6-12d5-4cc0-ae88-cfc2bab39db9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:11.985453 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f8180dc6-12d5-4cc0-ae88-cfc2bab39db9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:12.032584 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:28:12.063284 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-f8180dc6-12d5-4cc0-ae88-cfc2bab39db9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: c7d28599-67a9-4e84-a44d-79f1a6bf728f] Going to try to terminate instance {{(pid=117820) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 05:28:12.208846 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-f8180dc6-12d5-4cc0-ae88-cfc2bab39db9 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f" status: 204 len: 0 microversion: 2.1 time: 0.285269 Jul 29 05:28:12.210392 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 456/949] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 05:28:11 2022] DELETE /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 05:28:12.225590 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-c1bd5c26-51ff-40b0-b69b-f535325176b1 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:12.236597 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-c1bd5c26-51ff-40b0-b69b-f535325176b1 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: c7d28599-67a9-4e84-a44d-79f1a6bf728f] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:12.245175 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c1bd5c26-51ff-40b0-b69b-f535325176b1 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:12.246111 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c1bd5c26-51ff-40b0-b69b-f535325176b1 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:12.248216 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c1bd5c26-51ff-40b0-b69b-f535325176b1 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:12.249006 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c1bd5c26-51ff-40b0-b69b-f535325176b1 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:12.282342 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-7b75a216-0b1b-44a6-abe8-00e74804ed98 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:12.303151 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-7b75a216-0b1b-44a6-abe8-00e74804ed98 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1755 microversion: 2.1 time: 0.400703 Jul 29 05:28:12.315388 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 494/950] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:28:11 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1755 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:28:12.594532 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-c1bd5c26-51ff-40b0-b69b-f535325176b1 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:12.611455 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-c1bd5c26-51ff-40b0-b69b-f535325176b1 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f" status: 200 len: 1679 microversion: 2.1 time: 0.393541 Jul 29 05:28:12.624338 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 457/951] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:28:12 2022] GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f => generated 1679 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:28:13.352217 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-60c3022d-c158-4bb3-92cd-3424f87f3fb1 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:13.353311 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-60c3022d-c158-4bb3-92cd-3424f87f3fb1 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:13.373293 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-60c3022d-c158-4bb3-92cd-3424f87f3fb1 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:13.373608 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-60c3022d-c158-4bb3-92cd-3424f87f3fb1 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:13.375119 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-60c3022d-c158-4bb3-92cd-3424f87f3fb1 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:13.383666 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-60c3022d-c158-4bb3-92cd-3424f87f3fb1 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:13.676036 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-79a02409-d346-4dfb-9e87-186ad0b8c9ee tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:13.677316 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-79a02409-d346-4dfb-9e87-186ad0b8c9ee tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: c7d28599-67a9-4e84-a44d-79f1a6bf728f] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:13.698642 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-79a02409-d346-4dfb-9e87-186ad0b8c9ee tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:13.704134 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-79a02409-d346-4dfb-9e87-186ad0b8c9ee tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:13.705992 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-79a02409-d346-4dfb-9e87-186ad0b8c9ee tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:13.729364 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-79a02409-d346-4dfb-9e87-186ad0b8c9ee tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:14.147168 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-60c3022d-c158-4bb3-92cd-3424f87f3fb1 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:14.170537 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-60c3022d-c158-4bb3-92cd-3424f87f3fb1 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1755 microversion: 2.1 time: 0.825525 Jul 29 05:28:14.176174 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 495/952] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:28:13 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1755 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:28:14.558288 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-79a02409-d346-4dfb-9e87-186ad0b8c9ee tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:14.585499 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-79a02409-d346-4dfb-9e87-186ad0b8c9ee tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f" status: 200 len: 1679 microversion: 2.1 time: 0.929101 Jul 29 05:28:14.615225 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 458/953] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:28:13 2022] GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f => generated 1679 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:28:15.223202 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-b3d5392b-d375-4519-bd4a-6b0f469c4249 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:15.224332 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-b3d5392b-d375-4519-bd4a-6b0f469c4249 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:15.238333 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b3d5392b-d375-4519-bd4a-6b0f469c4249 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:15.240135 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b3d5392b-d375-4519-bd4a-6b0f469c4249 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:15.241944 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b3d5392b-d375-4519-bd4a-6b0f469c4249 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:15.244376 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b3d5392b-d375-4519-bd4a-6b0f469c4249 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:15.627029 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-d915e257-a944-474a-9cf8-41d490d4e795 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:15.627684 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-d915e257-a944-474a-9cf8-41d490d4e795 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: c7d28599-67a9-4e84-a44d-79f1a6bf728f] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:15.637510 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d915e257-a944-474a-9cf8-41d490d4e795 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:15.639824 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d915e257-a944-474a-9cf8-41d490d4e795 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:15.641261 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d915e257-a944-474a-9cf8-41d490d4e795 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:15.643722 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d915e257-a944-474a-9cf8-41d490d4e795 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:15.747063 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-b3d5392b-d375-4519-bd4a-6b0f469c4249 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:15.765757 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-b3d5392b-d375-4519-bd4a-6b0f469c4249 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1758 microversion: 2.1 time: 0.554192 Jul 29 05:28:15.767023 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 496/954] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:28:15 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1758 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:28:16.139337 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-d915e257-a944-474a-9cf8-41d490d4e795 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:16.163837 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-d915e257-a944-474a-9cf8-41d490d4e795 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f" status: 200 len: 1679 microversion: 2.1 time: 0.541135 Jul 29 05:28:16.165730 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 459/955] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:28:15 2022] GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f => generated 1679 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:28:17.203446 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-ae28d5b0-7a17-467f-9d52-ee5811ab58e7 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:17.204721 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-ae28d5b0-7a17-467f-9d52-ee5811ab58e7 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: c7d28599-67a9-4e84-a44d-79f1a6bf728f] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:17.217931 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ae28d5b0-7a17-467f-9d52-ee5811ab58e7 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:17.218639 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ae28d5b0-7a17-467f-9d52-ee5811ab58e7 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:17.219751 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ae28d5b0-7a17-467f-9d52-ee5811ab58e7 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:17.220355 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ae28d5b0-7a17-467f-9d52-ee5811ab58e7 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:17.291998 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-ae28d5b0-7a17-467f-9d52-ee5811ab58e7 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c60b3a983f14f50b1b762a3954a1059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8baaf2e23546ee8ed1de278617c7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:17.300433 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-ae28d5b0-7a17-467f-9d52-ee5811ab58e7 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f" status: 200 len: 1612 microversion: 2.1 time: 0.103875 Jul 29 05:28:17.301021 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 497/956] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:28:17 2022] GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f => generated 1612 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:28:17.742260 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-cb8e20fb-61c6-49e8-9aed-6985af9ae798 req-e0527d8d-cbf4-47b0-896d-da92bd3a7538 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7d28599-67a9-4e84-a44d-79f1a6bf728f", "name": "network-vif-deleted", "tag": "c7e12f70-c8c8-48ec-9fd7-5a69b095e812"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:28:17.768739 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-cb8e20fb-61c6-49e8-9aed-6985af9ae798 req-e0527d8d-cbf4-47b0-896d-da92bd3a7538 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:17.769305 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-cb8e20fb-61c6-49e8-9aed-6985af9ae798 req-e0527d8d-cbf4-47b0-896d-da92bd3a7538 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:17.811755 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-cb8e20fb-61c6-49e8-9aed-6985af9ae798 req-e0527d8d-cbf4-47b0-896d-da92bd3a7538 service nova] Creating event network-vif-deleted:c7e12f70-c8c8-48ec-9fd7-5a69b095e812 for instance c7d28599-67a9-4e84-a44d-79f1a6bf728f on hv-cinder-85127 Jul 29 05:28:17.823649 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-cb8e20fb-61c6-49e8-9aed-6985af9ae798 req-e0527d8d-cbf4-47b0-896d-da92bd3a7538 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085757 Jul 29 05:28:17.829332 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 460/957] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:28:18.335678 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-5752e72f-1021-4ccf-9220-d47330c87e4b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:18.337021 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-5752e72f-1021-4ccf-9220-d47330c87e4b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: c7d28599-67a9-4e84-a44d-79f1a6bf728f] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:18.351089 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5752e72f-1021-4ccf-9220-d47330c87e4b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:18.354083 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5752e72f-1021-4ccf-9220-d47330c87e4b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:18.358183 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5752e72f-1021-4ccf-9220-d47330c87e4b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:18.358618 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5752e72f-1021-4ccf-9220-d47330c87e4b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:18.394577 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.wsgi [None req-5752e72f-1021-4ccf-9220-d47330c87e4b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] HTTP exception thrown: Instance c7d28599-67a9-4e84-a44d-79f1a6bf728f could not be found. Jul 29 05:28:18.404756 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-5752e72f-1021-4ccf-9220-d47330c87e4b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Request method failure captured: Jul 29 05:28:18.404756 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: request: GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f HTTP/1.1 Jul 29 05:28:18.404756 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept: application/json Jul 29 05:28:18.404756 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept-Encoding: identity Jul 29 05:28:18.404756 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Connection: close Jul 29 05:28:18.404756 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Length: 0 Jul 29 05:28:18.404756 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Type: application/json Jul 29 05:28:18.404756 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Host: 10.222.0.49 Jul 29 05:28:18.404756 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Openstack-System-Scope: None Jul 29 05:28:18.404756 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: User-Agent: python-urllib3/1.26.10 Jul 29 05:28:18.404756 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Auth-Token: gAAAAABi425JZwki5zTQDTC3iukDv4VCbNzlxQK73dr9mClVYcp-Pvpl82CYunlqvLixJfXv6lMCmXCQFs-hx71b40CIPEvZNAkIclM8nEjPEEMC1q8Qnidc9zW9MB-6S0Nkj4s67ZnGkNw0VjcX1sLTyzzsa2KGY_dj5NlUwZaoPl1fActyKvM Jul 29 05:28:18.404756 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Id: None Jul 29 05:28:18.404756 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Name: None Jul 29 05:28:18.404756 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Identity-Status: Confirmed Jul 29 05:28:18.404756 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Is-Admin-Project: True Jul 29 05:28:18.404756 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Id: default Jul 29 05:28:18.404756 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Name: Default Jul 29 05:28:18.404756 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Id: 9d8baaf2e23546ee8ed1de278617c7d2 Jul 29 05:28:18.404756 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Name: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:28:18.404756 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Role: member,reader Jul 29 05:28:18.404756 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Roles: member,reader Jul 29 05:28:18.407065 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:28:18.407065 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:28:18.407065 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Id: 9d8baaf2e23546ee8ed1de278617c7d2 Jul 29 05:28:18.407065 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:28:18.407065 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User: tempest-AttachVolumeNegativeTest-480684510-project Jul 29 05:28:18.407065 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Id: default Jul 29 05:28:18.407065 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Name: Default Jul 29 05:28:18.407065 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Id: 3c60b3a983f14f50b1b762a3954a1059 Jul 29 05:28:18.407065 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Name: tempest-AttachVolumeNegativeTest-480684510-project Jul 29 05:28:18.407065 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: method: > Jul 29 05:28:18.407065 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: exception: Instance c7d28599-67a9-4e84-a44d-79f1a6bf728f could not be found. Jul 29 05:28:18.407065 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: action_args: {'id': 'c7d28599-67a9-4e84-a44d-79f1a6bf728f'} Jul 29 05:28:18.408267 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:28:18.408267 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:18.408267 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:28:18.408267 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:28:18.408267 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:28:18.408267 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:28:18.408267 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:28:18.408267 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:28:18.408267 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:28:18.408267 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:28:18.408267 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7d28599-67a9-4e84-a44d-79f1a6bf728f could not be found. Jul 29 05:28:18.408267 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:18.408267 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:28:18.408267 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:18.408267 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:18.408267 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:28:18.408267 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:28:18.408267 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:28:18.408267 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:28:18.408267 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:28:18.410099 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:28:18.410099 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:28:18.410099 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:28:18.410099 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:28:18.410099 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:28:18.410099 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:28:18.410099 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:28:18.410099 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7d28599-67a9-4e84-a44d-79f1a6bf728f could not be found. Jul 29 05:28:18.410099 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:18.410099 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:28:18.410099 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:18.410099 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:18.410099 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:28:18.410099 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:28:18.410099 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:28:18.410099 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:28:18.410099 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7d28599-67a9-4e84-a44d-79f1a6bf728f could not be found. Jul 29 05:28:18.410099 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:18.422201 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-5752e72f-1021-4ccf-9220-d47330c87e4b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Returning 404 to user: Instance c7d28599-67a9-4e84-a44d-79f1a6bf728f could not be found. {{(pid=117821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:28:18.423411 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-5752e72f-1021-4ccf-9220-d47330c87e4b tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f" status: 404 len: 111 microversion: 2.1 time: 0.092453 Jul 29 05:28:18.423974 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 498/958] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:28:18 2022] GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:28:18.437536 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-1f3263a3-b4ea-4ddb-8f8f-cdb2c0aa4cea tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '.version_select at 0x7fa63aaf5310>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:18.469261 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-1f3263a3-b4ea-4ddb-8f8f-cdb2c0aa4cea tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-39188921" status: 202 len: 0 microversion: 2.1 time: 0.037800 Jul 29 05:28:18.475861 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 461/959] 10.222.0.49 () {58 vars in 1215 bytes} [Fri Jul 29 05:28:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-39188921 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 05:28:20.815092 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-f96f751a-12a1-4c7c-b02d-ccfbea82af5c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:20.816018 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-f96f751a-12a1-4c7c-b02d-ccfbea82af5c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: c7d28599-67a9-4e84-a44d-79f1a6bf728f] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:20.844195 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f96f751a-12a1-4c7c-b02d-ccfbea82af5c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:20.845386 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f96f751a-12a1-4c7c-b02d-ccfbea82af5c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:20.851131 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f96f751a-12a1-4c7c-b02d-ccfbea82af5c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:20.852293 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f96f751a-12a1-4c7c-b02d-ccfbea82af5c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:20.876788 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.wsgi [None req-f96f751a-12a1-4c7c-b02d-ccfbea82af5c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] HTTP exception thrown: Instance c7d28599-67a9-4e84-a44d-79f1a6bf728f could not be found. Jul 29 05:28:20.888918 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-f96f751a-12a1-4c7c-b02d-ccfbea82af5c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Request method failure captured: Jul 29 05:28:20.888918 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: request: DELETE /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f HTTP/1.1 Jul 29 05:28:20.888918 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept: application/json Jul 29 05:28:20.888918 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept-Encoding: identity Jul 29 05:28:20.888918 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Connection: close Jul 29 05:28:20.888918 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Length: 0 Jul 29 05:28:20.888918 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Type: application/json Jul 29 05:28:20.888918 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Host: 10.222.0.49 Jul 29 05:28:20.888918 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Openstack-System-Scope: None Jul 29 05:28:20.888918 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: User-Agent: python-urllib3/1.26.10 Jul 29 05:28:20.888918 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Auth-Token: gAAAAABi425JZwki5zTQDTC3iukDv4VCbNzlxQK73dr9mClVYcp-Pvpl82CYunlqvLixJfXv6lMCmXCQFs-hx71b40CIPEvZNAkIclM8nEjPEEMC1q8Qnidc9zW9MB-6S0Nkj4s67ZnGkNw0VjcX1sLTyzzsa2KGY_dj5NlUwZaoPl1fActyKvM Jul 29 05:28:20.888918 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Id: None Jul 29 05:28:20.888918 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Name: None Jul 29 05:28:20.888918 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Identity-Status: Confirmed Jul 29 05:28:20.888918 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Is-Admin-Project: True Jul 29 05:28:20.888918 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Id: default Jul 29 05:28:20.888918 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Name: Default Jul 29 05:28:20.888918 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Id: 9d8baaf2e23546ee8ed1de278617c7d2 Jul 29 05:28:20.888918 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Name: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:28:20.888918 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Role: member,reader Jul 29 05:28:20.888918 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Roles: member,reader Jul 29 05:28:20.891547 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:28:20.891547 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:28:20.891547 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Id: 9d8baaf2e23546ee8ed1de278617c7d2 Jul 29 05:28:20.891547 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:28:20.891547 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User: tempest-AttachVolumeNegativeTest-480684510-project Jul 29 05:28:20.891547 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Id: default Jul 29 05:28:20.891547 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Name: Default Jul 29 05:28:20.891547 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Id: 3c60b3a983f14f50b1b762a3954a1059 Jul 29 05:28:20.891547 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Name: tempest-AttachVolumeNegativeTest-480684510-project Jul 29 05:28:20.891547 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: method: > Jul 29 05:28:20.891547 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: exception: Instance c7d28599-67a9-4e84-a44d-79f1a6bf728f could not be found. Jul 29 05:28:20.891547 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: action_args: {'id': 'c7d28599-67a9-4e84-a44d-79f1a6bf728f'} Jul 29 05:28:20.893127 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:28:20.893127 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:20.893127 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:28:20.893127 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:28:20.893127 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:28:20.893127 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:28:20.893127 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:28:20.893127 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:28:20.893127 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:28:20.893127 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:28:20.893127 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7d28599-67a9-4e84-a44d-79f1a6bf728f could not be found. Jul 29 05:28:20.893127 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:20.893127 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:28:20.893127 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:20.893127 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:20.893127 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:28:20.893127 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:28:20.893127 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:28:20.893127 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:28:20.893127 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:28:20.896349 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:28:20.896349 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 05:28:20.896349 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 05:28:20.896349 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 05:28:20.896349 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 05:28:20.896349 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:28:20.896349 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:28:20.896349 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:28:20.896349 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:28:20.896349 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7d28599-67a9-4e84-a44d-79f1a6bf728f could not be found. Jul 29 05:28:20.896349 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:20.896349 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:28:20.896349 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:20.896349 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:20.896349 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:28:20.896349 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:28:20.896349 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:28:20.896349 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:28:20.896349 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7d28599-67a9-4e84-a44d-79f1a6bf728f could not be found. Jul 29 05:28:20.896349 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:20.901004 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-f96f751a-12a1-4c7c-b02d-ccfbea82af5c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Returning 404 to user: Instance c7d28599-67a9-4e84-a44d-79f1a6bf728f could not be found. {{(pid=117821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:28:20.902950 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-f96f751a-12a1-4c7c-b02d-ccfbea82af5c tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f" status: 404 len: 111 microversion: 2.1 time: 0.101057 Jul 29 05:28:20.912308 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 499/960] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 05:28:20 2022] DELETE /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:28:20.916608 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-1afb7496-aab3-4317-88ce-72a2df1e4c55 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:20.917683 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-1afb7496-aab3-4317-88ce-72a2df1e4c55 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: c7d28599-67a9-4e84-a44d-79f1a6bf728f] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:20.941089 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1afb7496-aab3-4317-88ce-72a2df1e4c55 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:20.941684 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1afb7496-aab3-4317-88ce-72a2df1e4c55 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:20.942544 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1afb7496-aab3-4317-88ce-72a2df1e4c55 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:20.942992 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1afb7496-aab3-4317-88ce-72a2df1e4c55 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:20.964808 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.wsgi [None req-1afb7496-aab3-4317-88ce-72a2df1e4c55 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] HTTP exception thrown: Instance c7d28599-67a9-4e84-a44d-79f1a6bf728f could not be found. Jul 29 05:28:20.967185 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-1afb7496-aab3-4317-88ce-72a2df1e4c55 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Request method failure captured: Jul 29 05:28:20.967185 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: request: GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f HTTP/1.1 Jul 29 05:28:20.967185 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept: application/json Jul 29 05:28:20.967185 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept-Encoding: identity Jul 29 05:28:20.967185 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Connection: close Jul 29 05:28:20.967185 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Length: 0 Jul 29 05:28:20.967185 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Type: application/json Jul 29 05:28:20.967185 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Host: 10.222.0.49 Jul 29 05:28:20.967185 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Openstack-System-Scope: None Jul 29 05:28:20.967185 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: User-Agent: python-urllib3/1.26.10 Jul 29 05:28:20.967185 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Auth-Token: gAAAAABi425JZwki5zTQDTC3iukDv4VCbNzlxQK73dr9mClVYcp-Pvpl82CYunlqvLixJfXv6lMCmXCQFs-hx71b40CIPEvZNAkIclM8nEjPEEMC1q8Qnidc9zW9MB-6S0Nkj4s67ZnGkNw0VjcX1sLTyzzsa2KGY_dj5NlUwZaoPl1fActyKvM Jul 29 05:28:20.967185 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Id: None Jul 29 05:28:20.967185 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Name: None Jul 29 05:28:20.967185 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Identity-Status: Confirmed Jul 29 05:28:20.967185 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Is-Admin-Project: True Jul 29 05:28:20.967185 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Id: default Jul 29 05:28:20.967185 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Name: Default Jul 29 05:28:20.967185 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Id: 9d8baaf2e23546ee8ed1de278617c7d2 Jul 29 05:28:20.967185 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Name: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:28:20.967185 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Role: member,reader Jul 29 05:28:20.967185 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Roles: member,reader Jul 29 05:28:20.968775 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:28:20.968775 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:28:20.968775 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Id: 9d8baaf2e23546ee8ed1de278617c7d2 Jul 29 05:28:20.968775 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:28:20.968775 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User: tempest-AttachVolumeNegativeTest-480684510-project Jul 29 05:28:20.968775 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Id: default Jul 29 05:28:20.968775 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Name: Default Jul 29 05:28:20.968775 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Id: 3c60b3a983f14f50b1b762a3954a1059 Jul 29 05:28:20.968775 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Name: tempest-AttachVolumeNegativeTest-480684510-project Jul 29 05:28:20.968775 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: method: > Jul 29 05:28:20.968775 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: exception: Instance c7d28599-67a9-4e84-a44d-79f1a6bf728f could not be found. Jul 29 05:28:20.968775 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: action_args: {'id': 'c7d28599-67a9-4e84-a44d-79f1a6bf728f'} Jul 29 05:28:20.972736 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:28:20.972736 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:20.972736 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:28:20.972736 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:28:20.972736 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:28:20.972736 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:28:20.972736 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:28:20.972736 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:28:20.972736 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:28:20.972736 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:28:20.972736 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7d28599-67a9-4e84-a44d-79f1a6bf728f could not be found. Jul 29 05:28:20.972736 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:20.972736 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:28:20.972736 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:20.972736 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:20.972736 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:28:20.972736 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:28:20.972736 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:28:20.972736 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:28:20.972736 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:28:20.973952 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:28:20.973952 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:28:20.973952 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:28:20.973952 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:28:20.973952 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:28:20.973952 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:28:20.973952 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:28:20.973952 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7d28599-67a9-4e84-a44d-79f1a6bf728f could not be found. Jul 29 05:28:20.973952 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:20.973952 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:28:20.973952 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:20.973952 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:20.973952 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:28:20.973952 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:28:20.973952 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:28:20.973952 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:28:20.973952 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7d28599-67a9-4e84-a44d-79f1a6bf728f could not be found. Jul 29 05:28:20.973952 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:20.976207 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-1afb7496-aab3-4317-88ce-72a2df1e4c55 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Returning 404 to user: Instance c7d28599-67a9-4e84-a44d-79f1a6bf728f could not be found. {{(pid=117820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:28:20.976207 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-1afb7496-aab3-4317-88ce-72a2df1e4c55 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f" status: 404 len: 111 microversion: 2.1 time: 0.057530 Jul 29 05:28:20.976207 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 462/961] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:28:20 2022] GET /compute/v2.1/servers/c7d28599-67a9-4e84-a44d-79f1a6bf728f => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:28:22.193099 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-24111ccf-bcc4-4ff0-bb2b-b737b47510fb tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:22.194398 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-24111ccf-bcc4-4ff0-bb2b-b737b47510fb tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 4471f55c-7166-4321-b0ac-438ae8d3e5e2] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:22.202298 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-24111ccf-bcc4-4ff0-bb2b-b737b47510fb tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:22.204162 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-24111ccf-bcc4-4ff0-bb2b-b737b47510fb tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:22.205257 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-24111ccf-bcc4-4ff0-bb2b-b737b47510fb tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:22.205931 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-24111ccf-bcc4-4ff0-bb2b-b737b47510fb tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:22.226494 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.wsgi [None req-24111ccf-bcc4-4ff0-bb2b-b737b47510fb tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] HTTP exception thrown: Instance 4471f55c-7166-4321-b0ac-438ae8d3e5e2 could not be found. Jul 29 05:28:22.228289 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-24111ccf-bcc4-4ff0-bb2b-b737b47510fb tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Request method failure captured: Jul 29 05:28:22.228289 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: request: DELETE /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2 HTTP/1.1 Jul 29 05:28:22.228289 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept: application/json Jul 29 05:28:22.228289 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept-Encoding: identity Jul 29 05:28:22.228289 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Connection: close Jul 29 05:28:22.228289 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Length: 0 Jul 29 05:28:22.228289 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Type: application/json Jul 29 05:28:22.228289 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Host: 10.222.0.49 Jul 29 05:28:22.228289 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Openstack-System-Scope: None Jul 29 05:28:22.228289 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: User-Agent: python-urllib3/1.26.10 Jul 29 05:28:22.228289 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Auth-Token: gAAAAABi425JZwki5zTQDTC3iukDv4VCbNzlxQK73dr9mClVYcp-Pvpl82CYunlqvLixJfXv6lMCmXCQFs-hx71b40CIPEvZNAkIclM8nEjPEEMC1q8Qnidc9zW9MB-6S0Nkj4s67ZnGkNw0VjcX1sLTyzzsa2KGY_dj5NlUwZaoPl1fActyKvM Jul 29 05:28:22.228289 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Id: None Jul 29 05:28:22.228289 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Name: None Jul 29 05:28:22.228289 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Identity-Status: Confirmed Jul 29 05:28:22.228289 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Is-Admin-Project: True Jul 29 05:28:22.228289 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Id: default Jul 29 05:28:22.228289 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Name: Default Jul 29 05:28:22.228289 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Id: 9d8baaf2e23546ee8ed1de278617c7d2 Jul 29 05:28:22.228289 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Name: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:28:22.228289 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Role: member,reader Jul 29 05:28:22.228289 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Roles: member,reader Jul 29 05:28:22.229646 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:28:22.229646 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:28:22.229646 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Id: 9d8baaf2e23546ee8ed1de278617c7d2 Jul 29 05:28:22.229646 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:28:22.229646 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User: tempest-AttachVolumeNegativeTest-480684510-project Jul 29 05:28:22.229646 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Id: default Jul 29 05:28:22.229646 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Name: Default Jul 29 05:28:22.229646 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Id: 3c60b3a983f14f50b1b762a3954a1059 Jul 29 05:28:22.229646 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Name: tempest-AttachVolumeNegativeTest-480684510-project Jul 29 05:28:22.229646 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: method: > Jul 29 05:28:22.229646 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: exception: Instance 4471f55c-7166-4321-b0ac-438ae8d3e5e2 could not be found. Jul 29 05:28:22.229646 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: action_args: {'id': '4471f55c-7166-4321-b0ac-438ae8d3e5e2'} Jul 29 05:28:22.230411 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:28:22.230411 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:22.230411 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:28:22.230411 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:28:22.230411 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:28:22.230411 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:28:22.230411 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:28:22.230411 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:28:22.230411 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:28:22.230411 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:28:22.230411 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4471f55c-7166-4321-b0ac-438ae8d3e5e2 could not be found. Jul 29 05:28:22.230411 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:22.230411 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:28:22.230411 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:22.230411 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:22.230411 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:28:22.230411 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:28:22.230411 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:28:22.230411 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:28:22.230411 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:28:22.235095 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:28:22.235095 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 05:28:22.235095 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 05:28:22.235095 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 05:28:22.235095 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 05:28:22.235095 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:28:22.235095 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:28:22.235095 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:28:22.235095 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:28:22.235095 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4471f55c-7166-4321-b0ac-438ae8d3e5e2 could not be found. Jul 29 05:28:22.235095 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:22.235095 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:28:22.235095 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:22.235095 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:22.235095 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:28:22.235095 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:28:22.235095 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:28:22.235095 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:28:22.235095 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4471f55c-7166-4321-b0ac-438ae8d3e5e2 could not be found. Jul 29 05:28:22.235095 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:22.237375 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-24111ccf-bcc4-4ff0-bb2b-b737b47510fb tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Returning 404 to user: Instance 4471f55c-7166-4321-b0ac-438ae8d3e5e2 could not be found. {{(pid=117821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:28:22.237375 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-24111ccf-bcc4-4ff0-bb2b-b737b47510fb tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2" status: 404 len: 111 microversion: 2.1 time: 0.040780 Jul 29 05:28:22.237375 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 500/962] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 05:28:22 2022] DELETE /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:28:22.239744 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-d947a12f-a135-4d2c-9d29-253f533fbc57 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:22.240334 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-d947a12f-a135-4d2c-9d29-253f533fbc57 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 4471f55c-7166-4321-b0ac-438ae8d3e5e2] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:22.247636 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d947a12f-a135-4d2c-9d29-253f533fbc57 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:22.248086 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d947a12f-a135-4d2c-9d29-253f533fbc57 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:22.248880 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d947a12f-a135-4d2c-9d29-253f533fbc57 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:22.249320 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d947a12f-a135-4d2c-9d29-253f533fbc57 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:22.267307 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.wsgi [None req-d947a12f-a135-4d2c-9d29-253f533fbc57 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] HTTP exception thrown: Instance 4471f55c-7166-4321-b0ac-438ae8d3e5e2 could not be found. Jul 29 05:28:22.268979 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-d947a12f-a135-4d2c-9d29-253f533fbc57 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Request method failure captured: Jul 29 05:28:22.268979 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: request: GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2 HTTP/1.1 Jul 29 05:28:22.268979 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept: application/json Jul 29 05:28:22.268979 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept-Encoding: identity Jul 29 05:28:22.268979 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Connection: close Jul 29 05:28:22.268979 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Length: 0 Jul 29 05:28:22.268979 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Type: application/json Jul 29 05:28:22.268979 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Host: 10.222.0.49 Jul 29 05:28:22.268979 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Openstack-System-Scope: None Jul 29 05:28:22.268979 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: User-Agent: python-urllib3/1.26.10 Jul 29 05:28:22.268979 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Auth-Token: gAAAAABi425JZwki5zTQDTC3iukDv4VCbNzlxQK73dr9mClVYcp-Pvpl82CYunlqvLixJfXv6lMCmXCQFs-hx71b40CIPEvZNAkIclM8nEjPEEMC1q8Qnidc9zW9MB-6S0Nkj4s67ZnGkNw0VjcX1sLTyzzsa2KGY_dj5NlUwZaoPl1fActyKvM Jul 29 05:28:22.268979 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Id: None Jul 29 05:28:22.268979 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Name: None Jul 29 05:28:22.268979 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Identity-Status: Confirmed Jul 29 05:28:22.268979 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Is-Admin-Project: True Jul 29 05:28:22.268979 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Id: default Jul 29 05:28:22.268979 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Name: Default Jul 29 05:28:22.268979 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Id: 9d8baaf2e23546ee8ed1de278617c7d2 Jul 29 05:28:22.268979 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Name: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:28:22.268979 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Role: member,reader Jul 29 05:28:22.268979 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Roles: member,reader Jul 29 05:28:22.270350 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:28:22.270350 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:28:22.270350 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Id: 9d8baaf2e23546ee8ed1de278617c7d2 Jul 29 05:28:22.270350 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:28:22.270350 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User: tempest-AttachVolumeNegativeTest-480684510-project Jul 29 05:28:22.270350 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Id: default Jul 29 05:28:22.270350 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Name: Default Jul 29 05:28:22.270350 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Id: 3c60b3a983f14f50b1b762a3954a1059 Jul 29 05:28:22.270350 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Name: tempest-AttachVolumeNegativeTest-480684510-project Jul 29 05:28:22.270350 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: method: > Jul 29 05:28:22.270350 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: exception: Instance 4471f55c-7166-4321-b0ac-438ae8d3e5e2 could not be found. Jul 29 05:28:22.270350 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: action_args: {'id': '4471f55c-7166-4321-b0ac-438ae8d3e5e2'} Jul 29 05:28:22.271073 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:28:22.271073 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:22.271073 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:28:22.271073 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:28:22.271073 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:28:22.271073 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:28:22.271073 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:28:22.271073 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:28:22.271073 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:28:22.271073 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:28:22.271073 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4471f55c-7166-4321-b0ac-438ae8d3e5e2 could not be found. Jul 29 05:28:22.271073 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:22.271073 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:28:22.271073 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:22.271073 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:22.271073 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:28:22.271073 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:28:22.271073 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:28:22.271073 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:28:22.271073 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:28:22.276799 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:28:22.276799 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:28:22.276799 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:28:22.276799 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:28:22.276799 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:28:22.276799 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:28:22.276799 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:28:22.276799 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4471f55c-7166-4321-b0ac-438ae8d3e5e2 could not be found. Jul 29 05:28:22.276799 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:22.276799 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:28:22.276799 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:22.276799 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:22.276799 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:28:22.276799 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:28:22.276799 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:28:22.276799 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:28:22.276799 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4471f55c-7166-4321-b0ac-438ae8d3e5e2 could not be found. Jul 29 05:28:22.276799 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:22.280032 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-d947a12f-a135-4d2c-9d29-253f533fbc57 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Returning 404 to user: Instance 4471f55c-7166-4321-b0ac-438ae8d3e5e2 could not be found. {{(pid=117820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:28:22.280032 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-d947a12f-a135-4d2c-9d29-253f533fbc57 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2" status: 404 len: 111 microversion: 2.1 time: 0.035678 Jul 29 05:28:22.280032 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 463/963] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:28:22 2022] GET /compute/v2.1/servers/4471f55c-7166-4321-b0ac-438ae8d3e5e2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:28:22.280492 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-ac3ac198-1cd8-4b88-aa80-f4c84db61ae7 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:22.281009 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-ac3ac198-1cd8-4b88-aa80-f4c84db61ae7 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: b11929b6-7818-4cae-be4e-8941c93c6aca] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:22.289465 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ac3ac198-1cd8-4b88-aa80-f4c84db61ae7 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:22.289813 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ac3ac198-1cd8-4b88-aa80-f4c84db61ae7 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:22.291664 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ac3ac198-1cd8-4b88-aa80-f4c84db61ae7 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:22.292307 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-ac3ac198-1cd8-4b88-aa80-f4c84db61ae7 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:22.308100 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.wsgi [None req-ac3ac198-1cd8-4b88-aa80-f4c84db61ae7 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] HTTP exception thrown: Instance b11929b6-7818-4cae-be4e-8941c93c6aca could not be found. Jul 29 05:28:22.310195 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-ac3ac198-1cd8-4b88-aa80-f4c84db61ae7 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Request method failure captured: Jul 29 05:28:22.310195 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: request: DELETE /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca HTTP/1.1 Jul 29 05:28:22.310195 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept: application/json Jul 29 05:28:22.310195 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept-Encoding: identity Jul 29 05:28:22.310195 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Connection: close Jul 29 05:28:22.310195 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Length: 0 Jul 29 05:28:22.310195 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Type: application/json Jul 29 05:28:22.310195 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Host: 10.222.0.49 Jul 29 05:28:22.310195 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Openstack-System-Scope: None Jul 29 05:28:22.310195 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: User-Agent: python-urllib3/1.26.10 Jul 29 05:28:22.310195 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Auth-Token: gAAAAABi425JZwki5zTQDTC3iukDv4VCbNzlxQK73dr9mClVYcp-Pvpl82CYunlqvLixJfXv6lMCmXCQFs-hx71b40CIPEvZNAkIclM8nEjPEEMC1q8Qnidc9zW9MB-6S0Nkj4s67ZnGkNw0VjcX1sLTyzzsa2KGY_dj5NlUwZaoPl1fActyKvM Jul 29 05:28:22.310195 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Id: None Jul 29 05:28:22.310195 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Name: None Jul 29 05:28:22.310195 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Identity-Status: Confirmed Jul 29 05:28:22.310195 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Is-Admin-Project: True Jul 29 05:28:22.310195 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Id: default Jul 29 05:28:22.310195 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Name: Default Jul 29 05:28:22.310195 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Id: 9d8baaf2e23546ee8ed1de278617c7d2 Jul 29 05:28:22.310195 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Name: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:28:22.310195 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Role: member,reader Jul 29 05:28:22.310195 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Roles: member,reader Jul 29 05:28:22.311646 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:28:22.311646 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:28:22.311646 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Id: 9d8baaf2e23546ee8ed1de278617c7d2 Jul 29 05:28:22.311646 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:28:22.311646 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User: tempest-AttachVolumeNegativeTest-480684510-project Jul 29 05:28:22.311646 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Id: default Jul 29 05:28:22.311646 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Name: Default Jul 29 05:28:22.311646 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Id: 3c60b3a983f14f50b1b762a3954a1059 Jul 29 05:28:22.311646 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Name: tempest-AttachVolumeNegativeTest-480684510-project Jul 29 05:28:22.311646 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: method: > Jul 29 05:28:22.311646 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: exception: Instance b11929b6-7818-4cae-be4e-8941c93c6aca could not be found. Jul 29 05:28:22.311646 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: action_args: {'id': 'b11929b6-7818-4cae-be4e-8941c93c6aca'} Jul 29 05:28:22.316549 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:28:22.316549 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:22.316549 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:28:22.316549 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:28:22.316549 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:28:22.316549 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:28:22.316549 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:28:22.316549 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:28:22.316549 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:28:22.316549 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:28:22.316549 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b11929b6-7818-4cae-be4e-8941c93c6aca could not be found. Jul 29 05:28:22.316549 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:22.316549 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:28:22.316549 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:22.316549 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:22.316549 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:28:22.316549 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:28:22.316549 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:28:22.316549 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:28:22.316549 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:28:22.318022 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:28:22.318022 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 05:28:22.318022 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 05:28:22.318022 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 05:28:22.318022 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 05:28:22.318022 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:28:22.318022 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:28:22.318022 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:28:22.318022 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:28:22.318022 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b11929b6-7818-4cae-be4e-8941c93c6aca could not be found. Jul 29 05:28:22.318022 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:22.318022 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:28:22.318022 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:22.318022 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:22.318022 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:28:22.318022 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:28:22.318022 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:28:22.318022 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:28:22.318022 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b11929b6-7818-4cae-be4e-8941c93c6aca could not be found. Jul 29 05:28:22.318022 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:22.319530 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-ac3ac198-1cd8-4b88-aa80-f4c84db61ae7 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Returning 404 to user: Instance b11929b6-7818-4cae-be4e-8941c93c6aca could not be found. {{(pid=117821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:28:22.319530 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-ac3ac198-1cd8-4b88-aa80-f4c84db61ae7 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca" status: 404 len: 111 microversion: 2.1 time: 0.036042 Jul 29 05:28:22.319530 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 501/964] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 05:28:22 2022] DELETE /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:28:22.321721 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-6f400d9c-55c1-4aef-b54c-4ba10a93cba7 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:22.321721 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-6f400d9c-55c1-4aef-b54c-4ba10a93cba7 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: b11929b6-7818-4cae-be4e-8941c93c6aca] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:22.337765 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6f400d9c-55c1-4aef-b54c-4ba10a93cba7 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:22.338614 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6f400d9c-55c1-4aef-b54c-4ba10a93cba7 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:22.339888 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6f400d9c-55c1-4aef-b54c-4ba10a93cba7 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:22.341345 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6f400d9c-55c1-4aef-b54c-4ba10a93cba7 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:22.359782 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.wsgi [None req-6f400d9c-55c1-4aef-b54c-4ba10a93cba7 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] HTTP exception thrown: Instance b11929b6-7818-4cae-be4e-8941c93c6aca could not be found. Jul 29 05:28:22.361850 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-6f400d9c-55c1-4aef-b54c-4ba10a93cba7 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Request method failure captured: Jul 29 05:28:22.361850 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: request: GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca HTTP/1.1 Jul 29 05:28:22.361850 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept: application/json Jul 29 05:28:22.361850 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept-Encoding: identity Jul 29 05:28:22.361850 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Connection: close Jul 29 05:28:22.361850 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Length: 0 Jul 29 05:28:22.361850 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Type: application/json Jul 29 05:28:22.361850 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Host: 10.222.0.49 Jul 29 05:28:22.361850 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Openstack-System-Scope: None Jul 29 05:28:22.361850 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: User-Agent: python-urllib3/1.26.10 Jul 29 05:28:22.361850 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Auth-Token: gAAAAABi425JZwki5zTQDTC3iukDv4VCbNzlxQK73dr9mClVYcp-Pvpl82CYunlqvLixJfXv6lMCmXCQFs-hx71b40CIPEvZNAkIclM8nEjPEEMC1q8Qnidc9zW9MB-6S0Nkj4s67ZnGkNw0VjcX1sLTyzzsa2KGY_dj5NlUwZaoPl1fActyKvM Jul 29 05:28:22.361850 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Id: None Jul 29 05:28:22.361850 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Name: None Jul 29 05:28:22.361850 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Identity-Status: Confirmed Jul 29 05:28:22.361850 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Is-Admin-Project: True Jul 29 05:28:22.361850 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Id: default Jul 29 05:28:22.361850 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Name: Default Jul 29 05:28:22.361850 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Id: 9d8baaf2e23546ee8ed1de278617c7d2 Jul 29 05:28:22.361850 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Name: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:28:22.361850 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Role: member,reader Jul 29 05:28:22.361850 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Roles: member,reader Jul 29 05:28:22.363508 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:28:22.363508 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:28:22.363508 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Id: 9d8baaf2e23546ee8ed1de278617c7d2 Jul 29 05:28:22.363508 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:28:22.363508 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User: tempest-AttachVolumeNegativeTest-480684510-project Jul 29 05:28:22.363508 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Id: default Jul 29 05:28:22.363508 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Name: Default Jul 29 05:28:22.363508 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Id: 3c60b3a983f14f50b1b762a3954a1059 Jul 29 05:28:22.363508 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Name: tempest-AttachVolumeNegativeTest-480684510-project Jul 29 05:28:22.363508 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: method: > Jul 29 05:28:22.363508 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: exception: Instance b11929b6-7818-4cae-be4e-8941c93c6aca could not be found. Jul 29 05:28:22.363508 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: action_args: {'id': 'b11929b6-7818-4cae-be4e-8941c93c6aca'} Jul 29 05:28:22.364416 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:28:22.364416 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:22.364416 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:28:22.364416 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:28:22.364416 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:28:22.364416 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:28:22.364416 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:28:22.364416 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:28:22.364416 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:28:22.364416 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:28:22.364416 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b11929b6-7818-4cae-be4e-8941c93c6aca could not be found. Jul 29 05:28:22.364416 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:22.364416 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:28:22.364416 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:22.364416 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:22.364416 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:28:22.364416 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:28:22.364416 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:28:22.364416 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:28:22.364416 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:28:22.365868 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:28:22.365868 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:28:22.365868 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:28:22.365868 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:28:22.365868 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:28:22.365868 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:28:22.365868 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:28:22.365868 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b11929b6-7818-4cae-be4e-8941c93c6aca could not be found. Jul 29 05:28:22.365868 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:22.365868 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:28:22.365868 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:22.365868 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:22.365868 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:28:22.365868 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:28:22.365868 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:28:22.365868 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:28:22.365868 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b11929b6-7818-4cae-be4e-8941c93c6aca could not be found. Jul 29 05:28:22.365868 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:22.368665 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-6f400d9c-55c1-4aef-b54c-4ba10a93cba7 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Returning 404 to user: Instance b11929b6-7818-4cae-be4e-8941c93c6aca could not be found. {{(pid=117820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:28:22.369789 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-6f400d9c-55c1-4aef-b54c-4ba10a93cba7 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca" status: 404 len: 111 microversion: 2.1 time: 0.053183 Jul 29 05:28:22.371247 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 464/965] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:28:22 2022] GET /compute/v2.1/servers/b11929b6-7818-4cae-be4e-8941c93c6aca => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:28:25.827331 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-686795fb-22ab-4ea0-810e-e47d2a45f620 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:25.828193 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-686795fb-22ab-4ea0-810e-e47d2a45f620 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:25.883819 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-686795fb-22ab-4ea0-810e-e47d2a45f620 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:25.883819 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-686795fb-22ab-4ea0-810e-e47d2a45f620 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:25.883819 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-686795fb-22ab-4ea0-810e-e47d2a45f620 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:25.883819 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-686795fb-22ab-4ea0-810e-e47d2a45f620 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:25.912891 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.wsgi [None req-686795fb-22ab-4ea0-810e-e47d2a45f620 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] HTTP exception thrown: Instance 05c46947-e368-441d-9e07-584e95d55780 could not be found. Jul 29 05:28:25.916362 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-686795fb-22ab-4ea0-810e-e47d2a45f620 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Request method failure captured: Jul 29 05:28:25.916362 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: request: DELETE /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 HTTP/1.1 Jul 29 05:28:25.916362 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept: application/json Jul 29 05:28:25.916362 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept-Encoding: identity Jul 29 05:28:25.916362 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Connection: close Jul 29 05:28:25.916362 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Length: 0 Jul 29 05:28:25.916362 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Type: application/json Jul 29 05:28:25.916362 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Host: 10.222.0.49 Jul 29 05:28:25.916362 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Openstack-System-Scope: None Jul 29 05:28:25.916362 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: User-Agent: python-urllib3/1.26.10 Jul 29 05:28:25.916362 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Auth-Token: gAAAAABi425JZwki5zTQDTC3iukDv4VCbNzlxQK73dr9mClVYcp-Pvpl82CYunlqvLixJfXv6lMCmXCQFs-hx71b40CIPEvZNAkIclM8nEjPEEMC1q8Qnidc9zW9MB-6S0Nkj4s67ZnGkNw0VjcX1sLTyzzsa2KGY_dj5NlUwZaoPl1fActyKvM Jul 29 05:28:25.916362 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Id: None Jul 29 05:28:25.916362 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Name: None Jul 29 05:28:25.916362 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Identity-Status: Confirmed Jul 29 05:28:25.916362 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Is-Admin-Project: True Jul 29 05:28:25.916362 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Id: default Jul 29 05:28:25.916362 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Name: Default Jul 29 05:28:25.916362 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Id: 9d8baaf2e23546ee8ed1de278617c7d2 Jul 29 05:28:25.916362 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Name: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:28:25.916362 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Role: member,reader Jul 29 05:28:25.916362 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Roles: member,reader Jul 29 05:28:25.917854 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:28:25.917854 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:28:25.917854 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Id: 9d8baaf2e23546ee8ed1de278617c7d2 Jul 29 05:28:25.917854 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:28:25.917854 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User: tempest-AttachVolumeNegativeTest-480684510-project Jul 29 05:28:25.917854 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Id: default Jul 29 05:28:25.917854 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Name: Default Jul 29 05:28:25.917854 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Id: 3c60b3a983f14f50b1b762a3954a1059 Jul 29 05:28:25.917854 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Name: tempest-AttachVolumeNegativeTest-480684510-project Jul 29 05:28:25.917854 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: method: > Jul 29 05:28:25.917854 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: exception: Instance 05c46947-e368-441d-9e07-584e95d55780 could not be found. Jul 29 05:28:25.917854 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: action_args: {'id': '05c46947-e368-441d-9e07-584e95d55780'} Jul 29 05:28:25.918968 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:28:25.918968 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:25.918968 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:28:25.918968 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:28:25.918968 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:28:25.918968 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:28:25.918968 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:28:25.918968 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:28:25.918968 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:28:25.918968 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:28:25.918968 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05c46947-e368-441d-9e07-584e95d55780 could not be found. Jul 29 05:28:25.918968 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:25.918968 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:28:25.918968 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:25.918968 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:25.918968 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:28:25.918968 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:28:25.918968 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:28:25.918968 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:28:25.918968 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:28:25.920420 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:28:25.920420 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 05:28:25.920420 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 05:28:25.920420 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 05:28:25.920420 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 05:28:25.920420 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:28:25.920420 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:28:25.920420 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:28:25.920420 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:28:25.920420 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05c46947-e368-441d-9e07-584e95d55780 could not be found. Jul 29 05:28:25.920420 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:25.920420 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:28:25.920420 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:25.920420 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:25.920420 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:28:25.920420 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:28:25.920420 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:28:25.920420 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:28:25.920420 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05c46947-e368-441d-9e07-584e95d55780 could not be found. Jul 29 05:28:25.920420 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:25.921691 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-686795fb-22ab-4ea0-810e-e47d2a45f620 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Returning 404 to user: Instance 05c46947-e368-441d-9e07-584e95d55780 could not be found. {{(pid=117821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:28:25.921691 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-686795fb-22ab-4ea0-810e-e47d2a45f620 tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "DELETE /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780" status: 404 len: 111 microversion: 2.1 time: 0.113546 Jul 29 05:28:25.922158 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 502/966] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 05:28:25 2022] DELETE /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:28:25.930602 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-00284e44-a166-4ecc-9110-a20ed32d071e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:25.931321 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-00284e44-a166-4ecc-9110-a20ed32d071e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] [instance: 05c46947-e368-441d-9e07-584e95d55780] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:25.940159 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-00284e44-a166-4ecc-9110-a20ed32d071e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:25.940622 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-00284e44-a166-4ecc-9110-a20ed32d071e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:25.942141 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-00284e44-a166-4ecc-9110-a20ed32d071e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:25.942647 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-00284e44-a166-4ecc-9110-a20ed32d071e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:25.959559 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.wsgi [None req-00284e44-a166-4ecc-9110-a20ed32d071e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] HTTP exception thrown: Instance 05c46947-e368-441d-9e07-584e95d55780 could not be found. Jul 29 05:28:25.961289 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-00284e44-a166-4ecc-9110-a20ed32d071e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Request method failure captured: Jul 29 05:28:25.961289 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: request: GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 HTTP/1.1 Jul 29 05:28:25.961289 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept: application/json Jul 29 05:28:25.961289 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept-Encoding: identity Jul 29 05:28:25.961289 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Connection: close Jul 29 05:28:25.961289 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Length: 0 Jul 29 05:28:25.961289 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Type: application/json Jul 29 05:28:25.961289 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Host: 10.222.0.49 Jul 29 05:28:25.961289 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Openstack-System-Scope: None Jul 29 05:28:25.961289 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: User-Agent: python-urllib3/1.26.10 Jul 29 05:28:25.961289 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Auth-Token: gAAAAABi425JZwki5zTQDTC3iukDv4VCbNzlxQK73dr9mClVYcp-Pvpl82CYunlqvLixJfXv6lMCmXCQFs-hx71b40CIPEvZNAkIclM8nEjPEEMC1q8Qnidc9zW9MB-6S0Nkj4s67ZnGkNw0VjcX1sLTyzzsa2KGY_dj5NlUwZaoPl1fActyKvM Jul 29 05:28:25.961289 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Id: None Jul 29 05:28:25.961289 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Name: None Jul 29 05:28:25.961289 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Identity-Status: Confirmed Jul 29 05:28:25.961289 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Is-Admin-Project: True Jul 29 05:28:25.961289 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Id: default Jul 29 05:28:25.961289 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Name: Default Jul 29 05:28:25.961289 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Id: 9d8baaf2e23546ee8ed1de278617c7d2 Jul 29 05:28:25.961289 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Name: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:28:25.961289 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Role: member,reader Jul 29 05:28:25.961289 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Roles: member,reader Jul 29 05:28:25.966059 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9d8baaf2e23546ee8ed1de278617c7d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:28:25.966059 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:28:25.966059 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Id: 9d8baaf2e23546ee8ed1de278617c7d2 Jul 29 05:28:25.966059 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-480684510 Jul 29 05:28:25.966059 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User: tempest-AttachVolumeNegativeTest-480684510-project Jul 29 05:28:25.966059 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Id: default Jul 29 05:28:25.966059 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Name: Default Jul 29 05:28:25.966059 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Id: 3c60b3a983f14f50b1b762a3954a1059 Jul 29 05:28:25.966059 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Name: tempest-AttachVolumeNegativeTest-480684510-project Jul 29 05:28:25.966059 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: method: > Jul 29 05:28:25.966059 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: exception: Instance 05c46947-e368-441d-9e07-584e95d55780 could not be found. Jul 29 05:28:25.966059 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: action_args: {'id': '05c46947-e368-441d-9e07-584e95d55780'} Jul 29 05:28:25.968301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:28:25.968301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:25.968301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:28:25.968301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:28:25.968301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:28:25.968301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:28:25.968301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:28:25.968301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:28:25.968301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:28:25.968301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:28:25.968301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05c46947-e368-441d-9e07-584e95d55780 could not be found. Jul 29 05:28:25.968301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:25.968301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:28:25.968301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:25.968301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:25.968301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:28:25.968301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:28:25.968301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:28:25.968301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:28:25.968301 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:28:25.973042 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:28:25.973042 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:28:25.973042 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:28:25.973042 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:28:25.973042 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:28:25.973042 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:28:25.973042 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:28:25.973042 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05c46947-e368-441d-9e07-584e95d55780 could not be found. Jul 29 05:28:25.973042 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:25.973042 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:28:25.973042 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:25.973042 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:25.973042 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:28:25.973042 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:28:25.973042 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:28:25.973042 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:28:25.973042 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05c46947-e368-441d-9e07-584e95d55780 could not be found. Jul 29 05:28:25.973042 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:25.982525 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-00284e44-a166-4ecc-9110-a20ed32d071e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] Returning 404 to user: Instance 05c46947-e368-441d-9e07-584e95d55780 could not be found. {{(pid=117820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:28:25.982525 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-00284e44-a166-4ecc-9110-a20ed32d071e tempest-AttachVolumeNegativeTest-480684510 tempest-AttachVolumeNegativeTest-480684510-project] 10.222.0.49 "GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780" status: 404 len: 111 microversion: 2.1 time: 0.036749 Jul 29 05:28:25.982525 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 465/967] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:28:25 2022] GET /compute/v2.1/servers/05c46947-e368-441d-9e07-584e95d55780 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:28:26.453204 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-ef62b922-0209-49db-9a88-697aadd23391 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Action: 'create', calling method: .version_select at 0x7fa64011baf0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1818523598", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwxtH8gWIwxJ+NfVhHVjYA4gsaAa2kIKf9m2XsayAW3T//VPH4nLTkUmyZR4kmx56jzxPrRlj3oiH78V+apgvw+CrDrqmFHTJMppCNuWwmgZBg5p98IbxkcmZvsh3LZzg=="}} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:28:26.475272 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.quota [None req-ef62b922-0209-49db-9a88-697aadd23391 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Getting quotas for project 719297a86f0a4930b4daf3b9f663e472. Resources: {'key_pairs'} {{(pid=117821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:28:26.479890 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.quota [None req-ef62b922-0209-49db-9a88-697aadd23391 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Getting quotas for user 5b1d0da1157a46c283bd442ad14d31b5 and project 719297a86f0a4930b4daf3b9f663e472. Resources: {'key_pairs'} {{(pid=117821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:28:26.516037 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-ef62b922-0209-49db-9a88-697aadd23391 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.433398 Jul 29 05:28:26.516668 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 503/968] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Jul 29 05:28:26 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:28:43.031950 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-a6885fca-dd51-4ac3-8395-7070298760ea tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:43.034075 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-a6885fca-dd51-4ac3-8395-7070298760ea tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:43.036445 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:28:43.037190 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:28:43.045274 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a6885fca-dd51-4ac3-8395-7070298760ea tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:43.045913 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a6885fca-dd51-4ac3-8395-7070298760ea tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:43.047221 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a6885fca-dd51-4ac3-8395-7070298760ea tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:43.047758 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a6885fca-dd51-4ac3-8395-7070298760ea tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:43.088367 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-a6885fca-dd51-4ac3-8395-7070298760ea tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.061630 Jul 29 05:28:43.094749 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 466/969] 10.222.0.49 () {60 vars in 1343 bytes} [Fri Jul 29 05:28:43 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:28:43.159887 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell1:SELECT=48 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:28:43.161502 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell0:SELECT=4 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:28:43.162512 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:28:43.168822 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-eef8815c-4215-4e58-9fe9-996c26304e50 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:43.169711 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-eef8815c-4215-4e58-9fe9-996c26304e50 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:43.180502 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-eef8815c-4215-4e58-9fe9-996c26304e50 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:43.181131 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-eef8815c-4215-4e58-9fe9-996c26304e50 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:43.181952 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-eef8815c-4215-4e58-9fe9-996c26304e50 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:43.182396 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-eef8815c-4215-4e58-9fe9-996c26304e50 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:43.211623 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-eef8815c-4215-4e58-9fe9-996c26304e50 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Going to try to terminate instance {{(pid=117821) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 05:28:43.313092 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-eef8815c-4215-4e58-9fe9-996c26304e50 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 204 len: 0 microversion: 2.20 time: 0.154316 Jul 29 05:28:43.317065 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 504/970] 10.222.0.49 () {60 vars in 1280 bytes} [Fri Jul 29 05:28:43 2022] DELETE /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 29 05:28:43.323016 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-7dc5b43d-1a62-4e82-bbb6-6ba17196fdd6 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:43.324814 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-7dc5b43d-1a62-4e82-bbb6-6ba17196fdd6 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:43.331415 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7dc5b43d-1a62-4e82-bbb6-6ba17196fdd6 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:43.331959 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7dc5b43d-1a62-4e82-bbb6-6ba17196fdd6 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:43.332857 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7dc5b43d-1a62-4e82-bbb6-6ba17196fdd6 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:43.333370 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7dc5b43d-1a62-4e82-bbb6-6ba17196fdd6 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:43.487615 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-7dc5b43d-1a62-4e82-bbb6-6ba17196fdd6 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:43.496989 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-7dc5b43d-1a62-4e82-bbb6-6ba17196fdd6 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:43.498638 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-7dc5b43d-1a62-4e82-bbb6-6ba17196fdd6 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:43.499914 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-7dc5b43d-1a62-4e82-bbb6-6ba17196fdd6 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1722 microversion: 2.20 time: 0.181221 Jul 29 05:28:43.500475 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 467/971] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:28:43 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:28:44.543065 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-511030e5-0d86-4c3b-be45-01c91358b49a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:44.543795 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-511030e5-0d86-4c3b-be45-01c91358b49a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:44.550302 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-511030e5-0d86-4c3b-be45-01c91358b49a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:44.550751 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-511030e5-0d86-4c3b-be45-01c91358b49a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:44.551551 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-511030e5-0d86-4c3b-be45-01c91358b49a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:44.552069 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-511030e5-0d86-4c3b-be45-01c91358b49a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:44.688652 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-511030e5-0d86-4c3b-be45-01c91358b49a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:44.696831 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-511030e5-0d86-4c3b-be45-01c91358b49a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:44.700084 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-511030e5-0d86-4c3b-be45-01c91358b49a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:44.701374 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-511030e5-0d86-4c3b-be45-01c91358b49a tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1722 microversion: 2.20 time: 0.163236 Jul 29 05:28:44.702030 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 505/972] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:28:44 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:28:45.735914 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-5a956dce-e2dd-4afc-87f1-918e42b4c1da tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:45.737303 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-5a956dce-e2dd-4afc-87f1-918e42b4c1da tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:45.761462 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5a956dce-e2dd-4afc-87f1-918e42b4c1da tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:45.762004 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5a956dce-e2dd-4afc-87f1-918e42b4c1da tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:45.762847 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5a956dce-e2dd-4afc-87f1-918e42b4c1da tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:45.763296 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5a956dce-e2dd-4afc-87f1-918e42b4c1da tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:45.849055 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-5a956dce-e2dd-4afc-87f1-918e42b4c1da tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:45.859057 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-5a956dce-e2dd-4afc-87f1-918e42b4c1da tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:45.861072 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-5a956dce-e2dd-4afc-87f1-918e42b4c1da tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5a109a6fb94042aeacbf141d7322ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda8c6d9ffa4955b2f19411ee340cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:45.862372 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-5a956dce-e2dd-4afc-87f1-918e42b4c1da tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 200 len: 1655 microversion: 2.20 time: 0.139430 Jul 29 05:28:45.862999 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 468/973] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:28:45 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 1655 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:28:46.117299 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-77d71fce-ec5f-4070-8d2d-b6b103413bc2 req-165a19c5-1dcd-40ef-a0a3-43ca8894ddcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e3305fc-3d92-4d3f-afb8-c25395280792", "name": "network-vif-deleted", "tag": "6f412c06-c9c0-4423-b60d-0b7fa2c32b6f"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:28:46.133778 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-77d71fce-ec5f-4070-8d2d-b6b103413bc2 req-165a19c5-1dcd-40ef-a0a3-43ca8894ddcc service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:46.134383 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-77d71fce-ec5f-4070-8d2d-b6b103413bc2 req-165a19c5-1dcd-40ef-a0a3-43ca8894ddcc service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:46.174777 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-77d71fce-ec5f-4070-8d2d-b6b103413bc2 req-165a19c5-1dcd-40ef-a0a3-43ca8894ddcc service nova] Creating event network-vif-deleted:6f412c06-c9c0-4423-b60d-0b7fa2c32b6f for instance 1e3305fc-3d92-4d3f-afb8-c25395280792 on hv-cinder-85127 Jul 29 05:28:46.184898 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-77d71fce-ec5f-4070-8d2d-b6b103413bc2 req-165a19c5-1dcd-40ef-a0a3-43ca8894ddcc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071028 Jul 29 05:28:46.186301 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 506/974] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:28:46.894856 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-ef967387-14ed-4e01-81c0-ffc9b1a14aab tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:46.895711 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-ef967387-14ed-4e01-81c0-ffc9b1a14aab tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:46.903415 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ef967387-14ed-4e01-81c0-ffc9b1a14aab tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:46.904077 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ef967387-14ed-4e01-81c0-ffc9b1a14aab tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:46.904964 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ef967387-14ed-4e01-81c0-ffc9b1a14aab tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:46.905472 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ef967387-14ed-4e01-81c0-ffc9b1a14aab tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:46.921324 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.wsgi [None req-ef967387-14ed-4e01-81c0-ffc9b1a14aab tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] HTTP exception thrown: Instance 1e3305fc-3d92-4d3f-afb8-c25395280792 could not be found. Jul 29 05:28:46.922903 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-ef967387-14ed-4e01-81c0-ffc9b1a14aab tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Request method failure captured: Jul 29 05:28:46.922903 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: request: GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 HTTP/1.1 Jul 29 05:28:46.922903 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept: application/json Jul 29 05:28:46.922903 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept-Encoding: identity Jul 29 05:28:46.922903 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Connection: close Jul 29 05:28:46.922903 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Length: 0 Jul 29 05:28:46.922903 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Type: application/json Jul 29 05:28:46.922903 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Host: 10.222.0.49 Jul 29 05:28:46.922903 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Openstack-System-Scope: None Jul 29 05:28:46.922903 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: User-Agent: python-urllib3/1.26.10 Jul 29 05:28:46.922903 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Auth-Token: gAAAAABi425Wlc4p_qd8_4l8mvU_HADpC4ZjzYoo_9W1HUPbd6RmXuohTZ3lhQXrsrcNhSr9Qq_a7_8mhLduOPGGI8qOnU6NBJB60RVdJ2xWow69o4C1ksosKVYwMFUuC9f3Jm0QPh3neB_ZG_wUT7nqUKLPa-Xz0CfKRaQx9F_P-fYD8bG9Y5o Jul 29 05:28:46.922903 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Id: None Jul 29 05:28:46.922903 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Name: None Jul 29 05:28:46.922903 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Identity-Status: Confirmed Jul 29 05:28:46.922903 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Is-Admin-Project: True Jul 29 05:28:46.922903 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 05:28:46.922903 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Id: default Jul 29 05:28:46.922903 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Name: Default Jul 29 05:28:46.922903 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Id: 9fda8c6d9ffa4955b2f19411ee340cb3 Jul 29 05:28:46.922903 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1359370483 Jul 29 05:28:46.922903 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Role: member,reader Jul 29 05:28:46.922903 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Roles: member,reader Jul 29 05:28:46.924618 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9fda8c6d9ffa4955b2f19411ee340cb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9fda8c6d9ffa4955b2f19411ee340cb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9fda8c6d9ffa4955b2f19411ee340cb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9fda8c6d9ffa4955b2f19411ee340cb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:28:46.924618 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1359370483 Jul 29 05:28:46.924618 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Id: 9fda8c6d9ffa4955b2f19411ee340cb3 Jul 29 05:28:46.924618 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1359370483 Jul 29 05:28:46.924618 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User: tempest-AttachVolumeShelveTestJSON-1359370483-project Jul 29 05:28:46.924618 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Id: default Jul 29 05:28:46.924618 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Name: Default Jul 29 05:28:46.924618 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Id: af5a109a6fb94042aeacbf141d7322ef Jul 29 05:28:46.924618 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1359370483-project Jul 29 05:28:46.924618 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: method: > Jul 29 05:28:46.924618 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: exception: Instance 1e3305fc-3d92-4d3f-afb8-c25395280792 could not be found. Jul 29 05:28:46.924618 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: action_args: {'id': '1e3305fc-3d92-4d3f-afb8-c25395280792'} Jul 29 05:28:46.925570 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:28:46.925570 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:46.925570 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:28:46.925570 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:28:46.925570 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:28:46.925570 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:28:46.925570 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:28:46.925570 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:28:46.925570 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:28:46.925570 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:28:46.925570 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e3305fc-3d92-4d3f-afb8-c25395280792 could not be found. Jul 29 05:28:46.925570 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:46.925570 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:28:46.925570 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:46.925570 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:46.925570 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:28:46.925570 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:28:46.925570 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:28:46.925570 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:28:46.925570 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:28:46.927104 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:28:46.927104 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:28:46.927104 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:28:46.927104 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:28:46.927104 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:28:46.927104 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:28:46.927104 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:28:46.927104 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e3305fc-3d92-4d3f-afb8-c25395280792 could not be found. Jul 29 05:28:46.927104 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:46.927104 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:28:46.927104 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:46.927104 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:46.927104 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:28:46.927104 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:28:46.927104 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:28:46.927104 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:28:46.927104 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e3305fc-3d92-4d3f-afb8-c25395280792 could not be found. Jul 29 05:28:46.927104 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:46.928500 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-ef967387-14ed-4e01-81c0-ffc9b1a14aab tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Returning 404 to user: Instance 1e3305fc-3d92-4d3f-afb8-c25395280792 could not be found. {{(pid=117820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:28:46.928500 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-ef967387-14ed-4e01-81c0-ffc9b1a14aab tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 404 len: 111 microversion: 2.20 time: 0.035177 Jul 29 05:28:46.928500 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 469/975] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:28:46 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 29 05:28:46.936922 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-b6293879-984c-4616-9991-ee054790b895 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '.version_select at 0x7fa6414bd550>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:46.959479 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-b6293879-984c-4616-9991-ee054790b895 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-787158419" status: 204 len: 0 microversion: 2.20 time: 0.027858 Jul 29 05:28:46.960441 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 507/976] 10.222.0.49 () {60 vars in 1259 bytes} [Fri Jul 29 05:28:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-787158419 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 29 05:28:48.933249 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-418525b5-9ab4-4951-be54-2741befb932c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:48.934438 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-418525b5-9ab4-4951-be54-2741befb932c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:48.941410 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-418525b5-9ab4-4951-be54-2741befb932c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:48.941871 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-418525b5-9ab4-4951-be54-2741befb932c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:48.942655 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-418525b5-9ab4-4951-be54-2741befb932c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:48.943113 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-418525b5-9ab4-4951-be54-2741befb932c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:48.959037 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.wsgi [None req-418525b5-9ab4-4951-be54-2741befb932c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] HTTP exception thrown: Instance 1e3305fc-3d92-4d3f-afb8-c25395280792 could not be found. Jul 29 05:28:48.960669 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-418525b5-9ab4-4951-be54-2741befb932c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Request method failure captured: Jul 29 05:28:48.960669 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: request: DELETE /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 HTTP/1.1 Jul 29 05:28:48.960669 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept: application/json Jul 29 05:28:48.960669 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept-Encoding: identity Jul 29 05:28:48.960669 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Connection: close Jul 29 05:28:48.960669 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Length: 0 Jul 29 05:28:48.960669 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Type: application/json Jul 29 05:28:48.960669 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Host: 10.222.0.49 Jul 29 05:28:48.960669 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Openstack-System-Scope: None Jul 29 05:28:48.960669 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: User-Agent: python-urllib3/1.26.10 Jul 29 05:28:48.960669 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Auth-Token: gAAAAABi425Wlc4p_qd8_4l8mvU_HADpC4ZjzYoo_9W1HUPbd6RmXuohTZ3lhQXrsrcNhSr9Qq_a7_8mhLduOPGGI8qOnU6NBJB60RVdJ2xWow69o4C1ksosKVYwMFUuC9f3Jm0QPh3neB_ZG_wUT7nqUKLPa-Xz0CfKRaQx9F_P-fYD8bG9Y5o Jul 29 05:28:48.960669 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Id: None Jul 29 05:28:48.960669 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Name: None Jul 29 05:28:48.960669 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Identity-Status: Confirmed Jul 29 05:28:48.960669 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Is-Admin-Project: True Jul 29 05:28:48.960669 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 05:28:48.960669 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Id: default Jul 29 05:28:48.960669 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Name: Default Jul 29 05:28:48.960669 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Id: 9fda8c6d9ffa4955b2f19411ee340cb3 Jul 29 05:28:48.960669 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1359370483 Jul 29 05:28:48.960669 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Role: member,reader Jul 29 05:28:48.960669 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Roles: member,reader Jul 29 05:28:48.962370 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9fda8c6d9ffa4955b2f19411ee340cb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9fda8c6d9ffa4955b2f19411ee340cb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9fda8c6d9ffa4955b2f19411ee340cb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9fda8c6d9ffa4955b2f19411ee340cb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:28:48.962370 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1359370483 Jul 29 05:28:48.962370 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Id: 9fda8c6d9ffa4955b2f19411ee340cb3 Jul 29 05:28:48.962370 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1359370483 Jul 29 05:28:48.962370 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User: tempest-AttachVolumeShelveTestJSON-1359370483-project Jul 29 05:28:48.962370 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Id: default Jul 29 05:28:48.962370 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Name: Default Jul 29 05:28:48.962370 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Id: af5a109a6fb94042aeacbf141d7322ef Jul 29 05:28:48.962370 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1359370483-project Jul 29 05:28:48.962370 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: method: > Jul 29 05:28:48.962370 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: exception: Instance 1e3305fc-3d92-4d3f-afb8-c25395280792 could not be found. Jul 29 05:28:48.962370 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: action_args: {'id': '1e3305fc-3d92-4d3f-afb8-c25395280792'} Jul 29 05:28:48.963285 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:28:48.963285 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:48.963285 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:28:48.963285 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:28:48.963285 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:28:48.963285 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:28:48.963285 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:28:48.963285 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:28:48.963285 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:28:48.963285 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:28:48.963285 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e3305fc-3d92-4d3f-afb8-c25395280792 could not be found. Jul 29 05:28:48.963285 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:48.963285 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:28:48.963285 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:48.963285 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:48.963285 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:28:48.963285 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:28:48.963285 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:28:48.963285 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:28:48.963285 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:28:48.964786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:28:48.964786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 05:28:48.964786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 05:28:48.964786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 05:28:48.964786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 05:28:48.964786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:28:48.964786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:28:48.964786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:28:48.964786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:28:48.964786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e3305fc-3d92-4d3f-afb8-c25395280792 could not be found. Jul 29 05:28:48.964786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:48.964786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:28:48.964786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:48.964786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:48.964786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:28:48.964786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:28:48.964786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:28:48.964786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:28:48.964786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e3305fc-3d92-4d3f-afb8-c25395280792 could not be found. Jul 29 05:28:48.964786 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:28:48.966215 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-418525b5-9ab4-4951-be54-2741befb932c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Returning 404 to user: Instance 1e3305fc-3d92-4d3f-afb8-c25395280792 could not be found. {{(pid=117820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:28:48.966215 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-418525b5-9ab4-4951-be54-2741befb932c tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 404 len: 111 microversion: 2.20 time: 0.033030 Jul 29 05:28:48.966215 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 470/977] 10.222.0.49 () {60 vars in 1280 bytes} [Fri Jul 29 05:28:48 2022] DELETE /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 29 05:28:48.980489 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-58b32f26-4998-4de6-ad2e-a2d68e4d4f79 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:48.981527 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-58b32f26-4998-4de6-ad2e-a2d68e4d4f79 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 1e3305fc-3d92-4d3f-afb8-c25395280792] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:48.989610 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-58b32f26-4998-4de6-ad2e-a2d68e4d4f79 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:48.990257 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-58b32f26-4998-4de6-ad2e-a2d68e4d4f79 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:48.990914 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-58b32f26-4998-4de6-ad2e-a2d68e4d4f79 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:48.991252 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-58b32f26-4998-4de6-ad2e-a2d68e4d4f79 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:49.008533 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.wsgi [None req-58b32f26-4998-4de6-ad2e-a2d68e4d4f79 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] HTTP exception thrown: Instance 1e3305fc-3d92-4d3f-afb8-c25395280792 could not be found. Jul 29 05:28:49.010220 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-58b32f26-4998-4de6-ad2e-a2d68e4d4f79 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Request method failure captured: Jul 29 05:28:49.010220 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: request: GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 HTTP/1.1 Jul 29 05:28:49.010220 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept: application/json Jul 29 05:28:49.010220 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept-Encoding: identity Jul 29 05:28:49.010220 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Connection: close Jul 29 05:28:49.010220 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Length: 0 Jul 29 05:28:49.010220 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Type: application/json Jul 29 05:28:49.010220 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Host: 10.222.0.49 Jul 29 05:28:49.010220 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Openstack-System-Scope: None Jul 29 05:28:49.010220 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: User-Agent: python-urllib3/1.26.10 Jul 29 05:28:49.010220 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Auth-Token: gAAAAABi425Wlc4p_qd8_4l8mvU_HADpC4ZjzYoo_9W1HUPbd6RmXuohTZ3lhQXrsrcNhSr9Qq_a7_8mhLduOPGGI8qOnU6NBJB60RVdJ2xWow69o4C1ksosKVYwMFUuC9f3Jm0QPh3neB_ZG_wUT7nqUKLPa-Xz0CfKRaQx9F_P-fYD8bG9Y5o Jul 29 05:28:49.010220 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Id: None Jul 29 05:28:49.010220 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Name: None Jul 29 05:28:49.010220 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Identity-Status: Confirmed Jul 29 05:28:49.010220 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Is-Admin-Project: True Jul 29 05:28:49.010220 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 05:28:49.010220 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Id: default Jul 29 05:28:49.010220 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Name: Default Jul 29 05:28:49.010220 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Id: 9fda8c6d9ffa4955b2f19411ee340cb3 Jul 29 05:28:49.010220 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1359370483 Jul 29 05:28:49.010220 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Role: member,reader Jul 29 05:28:49.010220 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Roles: member,reader Jul 29 05:28:49.012754 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9fda8c6d9ffa4955b2f19411ee340cb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9fda8c6d9ffa4955b2f19411ee340cb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9fda8c6d9ffa4955b2f19411ee340cb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9fda8c6d9ffa4955b2f19411ee340cb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:28:49.012754 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1359370483 Jul 29 05:28:49.012754 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Id: 9fda8c6d9ffa4955b2f19411ee340cb3 Jul 29 05:28:49.012754 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1359370483 Jul 29 05:28:49.012754 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User: tempest-AttachVolumeShelveTestJSON-1359370483-project Jul 29 05:28:49.012754 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Id: default Jul 29 05:28:49.012754 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Name: Default Jul 29 05:28:49.012754 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Id: af5a109a6fb94042aeacbf141d7322ef Jul 29 05:28:49.012754 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1359370483-project Jul 29 05:28:49.012754 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: method: > Jul 29 05:28:49.012754 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: exception: Instance 1e3305fc-3d92-4d3f-afb8-c25395280792 could not be found. Jul 29 05:28:49.012754 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: action_args: {'id': '1e3305fc-3d92-4d3f-afb8-c25395280792'} Jul 29 05:28:49.013569 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:28:49.013569 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:49.013569 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:28:49.013569 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:28:49.013569 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:28:49.013569 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:28:49.013569 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:28:49.013569 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:28:49.013569 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:28:49.013569 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:28:49.013569 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e3305fc-3d92-4d3f-afb8-c25395280792 could not be found. Jul 29 05:28:49.013569 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:49.013569 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:28:49.013569 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:49.013569 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:49.013569 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:28:49.013569 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:28:49.013569 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:28:49.013569 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:28:49.013569 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:28:49.014852 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:28:49.014852 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:28:49.014852 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:28:49.014852 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:28:49.014852 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:28:49.014852 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:28:49.014852 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:28:49.014852 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e3305fc-3d92-4d3f-afb8-c25395280792 could not be found. Jul 29 05:28:49.014852 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:49.014852 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:28:49.014852 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:49.014852 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:49.014852 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:28:49.014852 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:28:49.014852 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:28:49.014852 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:28:49.014852 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e3305fc-3d92-4d3f-afb8-c25395280792 could not be found. Jul 29 05:28:49.014852 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:49.016540 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-58b32f26-4998-4de6-ad2e-a2d68e4d4f79 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Returning 404 to user: Instance 1e3305fc-3d92-4d3f-afb8-c25395280792 could not be found. {{(pid=117821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:28:49.016540 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-58b32f26-4998-4de6-ad2e-a2d68e4d4f79 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792" status: 404 len: 111 microversion: 2.20 time: 0.042445 Jul 29 05:28:49.016540 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 508/978] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:28:48 2022] GET /compute/v2.1/servers/1e3305fc-3d92-4d3f-afb8-c25395280792 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 29 05:28:49.673720 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-bd0bf1a7-0ec9-46d4-acc6-a35da63691d7 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1370925379", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1818523598", "security_groups": [{"name": "tempest-secgroup-smoke-2041740346"}], "networks": [{"uuid": "bf6a3cea-818f-4098-a73e-2bd56be30084"}], "block_device_mapping_v2": [{"uuid": "08484781-4115-4d80-b098-c2d0f03e96a6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:28:49.789724 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.network.neutron [None req-bd0bf1a7-0ec9-46d4-acc6-a35da63691d7 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] validate_networks() for [('bf6a3cea-818f-4098-a73e-2bd56be30084', None, None, None, None, None)] {{(pid=117820) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 05:28:50.184611 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-0fd5eda6-58db-476a-bc4e-b3bc9041818e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:50.185317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-0fd5eda6-58db-476a-bc4e-b3bc9041818e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:50.191810 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0fd5eda6-58db-476a-bc4e-b3bc9041818e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:50.192258 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0fd5eda6-58db-476a-bc4e-b3bc9041818e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:50.192424 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-bd0bf1a7-0ec9-46d4-acc6-a35da63691d7 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Flavor limits 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 05:28:50.192885 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-bd0bf1a7-0ec9-46d4-acc6-a35da63691d7 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Image limits 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 05:28:50.193064 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0fd5eda6-58db-476a-bc4e-b3bc9041818e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:50.193494 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0fd5eda6-58db-476a-bc4e-b3bc9041818e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:50.193732 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-bd0bf1a7-0ec9-46d4-acc6-a35da63691d7 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Flavor pref 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 05:28:50.195198 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-bd0bf1a7-0ec9-46d4-acc6-a35da63691d7 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Image pref 0:0:0 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 05:28:50.195689 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.virt.hardware [None req-bd0bf1a7-0ec9-46d4-acc6-a35da63691d7 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 05:28:50.206985 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bd0bf1a7-0ec9-46d4-acc6-a35da63691d7 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:50.207600 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bd0bf1a7-0ec9-46d4-acc6-a35da63691d7 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:50.208941 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bd0bf1a7-0ec9-46d4-acc6-a35da63691d7 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:50.209468 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bd0bf1a7-0ec9-46d4-acc6-a35da63691d7 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:50.211945 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.wsgi [None req-0fd5eda6-58db-476a-bc4e-b3bc9041818e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] HTTP exception thrown: Instance 6ff4221e-eadc-491b-9f3c-9b41413a63d0 could not be found. Jul 29 05:28:50.213533 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-0fd5eda6-58db-476a-bc4e-b3bc9041818e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Request method failure captured: Jul 29 05:28:50.213533 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: request: DELETE /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 HTTP/1.1 Jul 29 05:28:50.213533 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept: application/json Jul 29 05:28:50.213533 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept-Encoding: identity Jul 29 05:28:50.213533 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Connection: close Jul 29 05:28:50.213533 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Length: 0 Jul 29 05:28:50.213533 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Type: application/json Jul 29 05:28:50.213533 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Host: 10.222.0.49 Jul 29 05:28:50.213533 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Openstack-System-Scope: None Jul 29 05:28:50.213533 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: User-Agent: python-urllib3/1.26.10 Jul 29 05:28:50.213533 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Auth-Token: gAAAAABi425Wlc4p_qd8_4l8mvU_HADpC4ZjzYoo_9W1HUPbd6RmXuohTZ3lhQXrsrcNhSr9Qq_a7_8mhLduOPGGI8qOnU6NBJB60RVdJ2xWow69o4C1ksosKVYwMFUuC9f3Jm0QPh3neB_ZG_wUT7nqUKLPa-Xz0CfKRaQx9F_P-fYD8bG9Y5o Jul 29 05:28:50.213533 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Id: None Jul 29 05:28:50.213533 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Name: None Jul 29 05:28:50.213533 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Identity-Status: Confirmed Jul 29 05:28:50.213533 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Is-Admin-Project: True Jul 29 05:28:50.213533 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 05:28:50.213533 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Id: default Jul 29 05:28:50.213533 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Name: Default Jul 29 05:28:50.213533 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Id: 9fda8c6d9ffa4955b2f19411ee340cb3 Jul 29 05:28:50.213533 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1359370483 Jul 29 05:28:50.213533 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Role: member,reader Jul 29 05:28:50.213533 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Roles: member,reader Jul 29 05:28:50.215043 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9fda8c6d9ffa4955b2f19411ee340cb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9fda8c6d9ffa4955b2f19411ee340cb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9fda8c6d9ffa4955b2f19411ee340cb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9fda8c6d9ffa4955b2f19411ee340cb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:28:50.215043 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1359370483 Jul 29 05:28:50.215043 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Id: 9fda8c6d9ffa4955b2f19411ee340cb3 Jul 29 05:28:50.215043 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1359370483 Jul 29 05:28:50.215043 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User: tempest-AttachVolumeShelveTestJSON-1359370483-project Jul 29 05:28:50.215043 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Id: default Jul 29 05:28:50.215043 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Name: Default Jul 29 05:28:50.215043 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Id: af5a109a6fb94042aeacbf141d7322ef Jul 29 05:28:50.215043 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1359370483-project Jul 29 05:28:50.215043 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: method: > Jul 29 05:28:50.215043 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: exception: Instance 6ff4221e-eadc-491b-9f3c-9b41413a63d0 could not be found. Jul 29 05:28:50.215043 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: action_args: {'id': '6ff4221e-eadc-491b-9f3c-9b41413a63d0'} Jul 29 05:28:50.216711 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:28:50.216711 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:50.216711 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:28:50.216711 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:28:50.216711 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:28:50.216711 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:28:50.216711 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:28:50.216711 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:28:50.216711 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:28:50.216711 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:28:50.216711 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ff4221e-eadc-491b-9f3c-9b41413a63d0 could not be found. Jul 29 05:28:50.216711 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:50.216711 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:28:50.216711 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:50.216711 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:50.216711 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:28:50.216711 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:28:50.216711 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:28:50.216711 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:28:50.216711 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:28:50.217970 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:28:50.217970 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 05:28:50.217970 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 05:28:50.217970 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 05:28:50.217970 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 05:28:50.217970 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:28:50.217970 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:28:50.217970 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:28:50.217970 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:28:50.217970 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ff4221e-eadc-491b-9f3c-9b41413a63d0 could not be found. Jul 29 05:28:50.217970 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:50.217970 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:28:50.217970 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:50.217970 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:50.217970 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:28:50.217970 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:28:50.217970 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:28:50.217970 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:28:50.217970 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ff4221e-eadc-491b-9f3c-9b41413a63d0 could not be found. Jul 29 05:28:50.217970 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:50.219219 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-0fd5eda6-58db-476a-bc4e-b3bc9041818e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Returning 404 to user: Instance 6ff4221e-eadc-491b-9f3c-9b41413a63d0 could not be found. {{(pid=117821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:28:50.219219 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-0fd5eda6-58db-476a-bc4e-b3bc9041818e tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 404 len: 111 microversion: 2.20 time: 0.034558 Jul 29 05:28:50.219219 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 509/979] 10.222.0.49 () {60 vars in 1280 bytes} [Fri Jul 29 05:28:50 2022] DELETE /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 29 05:28:50.225619 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-9c25ca44-657d-4584-9dd9-f0b530f98284 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:50.226221 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-9c25ca44-657d-4584-9dd9-f0b530f98284 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] [instance: 6ff4221e-eadc-491b-9f3c-9b41413a63d0] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:50.233318 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9c25ca44-657d-4584-9dd9-f0b530f98284 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:50.233719 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9c25ca44-657d-4584-9dd9-f0b530f98284 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:50.234463 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9c25ca44-657d-4584-9dd9-f0b530f98284 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:50.234900 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-9c25ca44-657d-4584-9dd9-f0b530f98284 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:50.237100 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.quota [None req-bd0bf1a7-0ec9-46d4-acc6-a35da63691d7 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Getting quotas for project 719297a86f0a4930b4daf3b9f663e472. Resources: {'instances', 'ram', 'cores'} {{(pid=117820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:28:50.240956 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.quota [None req-bd0bf1a7-0ec9-46d4-acc6-a35da63691d7 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Getting quotas for user 5b1d0da1157a46c283bd442ad14d31b5 and project 719297a86f0a4930b4daf3b9f663e472. Resources: {'instances', 'ram', 'cores'} {{(pid=117820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:28:50.249943 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.wsgi [None req-9c25ca44-657d-4584-9dd9-f0b530f98284 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] HTTP exception thrown: Instance 6ff4221e-eadc-491b-9f3c-9b41413a63d0 could not be found. Jul 29 05:28:50.252811 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-9c25ca44-657d-4584-9dd9-f0b530f98284 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Request method failure captured: Jul 29 05:28:50.252811 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: request: GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 HTTP/1.1 Jul 29 05:28:50.252811 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept: application/json Jul 29 05:28:50.252811 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept-Encoding: identity Jul 29 05:28:50.252811 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Connection: close Jul 29 05:28:50.252811 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Length: 0 Jul 29 05:28:50.252811 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Type: application/json Jul 29 05:28:50.252811 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Host: 10.222.0.49 Jul 29 05:28:50.252811 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Openstack-System-Scope: None Jul 29 05:28:50.252811 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: User-Agent: python-urllib3/1.26.10 Jul 29 05:28:50.252811 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Auth-Token: gAAAAABi425Wlc4p_qd8_4l8mvU_HADpC4ZjzYoo_9W1HUPbd6RmXuohTZ3lhQXrsrcNhSr9Qq_a7_8mhLduOPGGI8qOnU6NBJB60RVdJ2xWow69o4C1ksosKVYwMFUuC9f3Jm0QPh3neB_ZG_wUT7nqUKLPa-Xz0CfKRaQx9F_P-fYD8bG9Y5o Jul 29 05:28:50.252811 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Id: None Jul 29 05:28:50.252811 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Name: None Jul 29 05:28:50.252811 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Identity-Status: Confirmed Jul 29 05:28:50.252811 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Is-Admin-Project: True Jul 29 05:28:50.252811 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 05:28:50.252811 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Id: default Jul 29 05:28:50.252811 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Name: Default Jul 29 05:28:50.252811 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Id: 9fda8c6d9ffa4955b2f19411ee340cb3 Jul 29 05:28:50.252811 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1359370483 Jul 29 05:28:50.252811 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Role: member,reader Jul 29 05:28:50.252811 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Roles: member,reader Jul 29 05:28:50.255116 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9fda8c6d9ffa4955b2f19411ee340cb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9fda8c6d9ffa4955b2f19411ee340cb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9fda8c6d9ffa4955b2f19411ee340cb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9fda8c6d9ffa4955b2f19411ee340cb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:28:50.255116 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1359370483 Jul 29 05:28:50.255116 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Id: 9fda8c6d9ffa4955b2f19411ee340cb3 Jul 29 05:28:50.255116 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1359370483 Jul 29 05:28:50.255116 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User: tempest-AttachVolumeShelveTestJSON-1359370483-project Jul 29 05:28:50.255116 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Id: default Jul 29 05:28:50.255116 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Name: Default Jul 29 05:28:50.255116 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Id: af5a109a6fb94042aeacbf141d7322ef Jul 29 05:28:50.255116 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1359370483-project Jul 29 05:28:50.255116 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: method: > Jul 29 05:28:50.255116 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: exception: Instance 6ff4221e-eadc-491b-9f3c-9b41413a63d0 could not be found. Jul 29 05:28:50.255116 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: action_args: {'id': '6ff4221e-eadc-491b-9f3c-9b41413a63d0'} Jul 29 05:28:50.256097 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:28:50.256097 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:50.256097 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:28:50.256097 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:28:50.256097 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:28:50.256097 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:28:50.256097 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:28:50.256097 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:28:50.256097 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:28:50.256097 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:28:50.256097 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ff4221e-eadc-491b-9f3c-9b41413a63d0 could not be found. Jul 29 05:28:50.256097 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:50.256097 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:28:50.256097 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:50.256097 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:50.256097 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:28:50.256097 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:28:50.256097 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:28:50.256097 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:28:50.256097 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:28:50.257532 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:28:50.257532 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:28:50.257532 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:28:50.257532 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:28:50.257532 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:28:50.257532 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:28:50.257532 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:28:50.257532 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ff4221e-eadc-491b-9f3c-9b41413a63d0 could not be found. Jul 29 05:28:50.257532 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:50.257532 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:28:50.257532 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:50.257532 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:28:50.257532 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:28:50.257532 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:28:50.257532 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:28:50.257532 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:28:50.257532 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ff4221e-eadc-491b-9f3c-9b41413a63d0 could not be found. Jul 29 05:28:50.257532 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:28:50.258857 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-9c25ca44-657d-4584-9dd9-f0b530f98284 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] Returning 404 to user: Instance 6ff4221e-eadc-491b-9f3c-9b41413a63d0 could not be found. {{(pid=117821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:28:50.258857 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-9c25ca44-657d-4584-9dd9-f0b530f98284 tempest-AttachVolumeShelveTestJSON-1359370483 tempest-AttachVolumeShelveTestJSON-1359370483-project] 10.222.0.49 "GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0" status: 404 len: 111 microversion: 2.20 time: 0.031712 Jul 29 05:28:50.258857 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 510/980] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 05:28:50 2022] GET /compute/v2.1/servers/6ff4221e-eadc-491b-9f3c-9b41413a63d0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 29 05:28:50.309991 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-bd0bf1a7-0ec9-46d4-acc6-a35da63691d7 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Going to run 1 instances... {{(pid=117820) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 05:28:50.312162 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-bd0bf1a7-0ec9-46d4-acc6-a35da63691d7 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='08484781-4115-4d80-b098-c2d0f03e96a6',volume_size=None,volume_type=None)] {{(pid=117820) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 05:28:50.454626 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-bd0bf1a7-0ec9-46d4-acc6-a35da63691d7 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.785781 Jul 29 05:28:50.455570 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 471/981] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 05:28:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 05:28:50.466255 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-cb5b1a07-8461-4462-82b1-d79f5b310f33 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:50.467239 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-cb5b1a07-8461-4462-82b1-d79f5b310f33 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:50.535126 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-cb5b1a07-8461-4462-82b1-d79f5b310f33 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:50.543550 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-cb5b1a07-8461-4462-82b1-d79f5b310f33 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1089 microversion: 2.1 time: 0.081025 Jul 29 05:28:50.544532 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 511/982] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:28:50 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1089 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:28:51.565255 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-770b3ef3-0cc1-4bed-88d9-c4cade9b9394 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:51.566576 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-770b3ef3-0cc1-4bed-88d9-c4cade9b9394 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:51.573680 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-770b3ef3-0cc1-4bed-88d9-c4cade9b9394 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:51.574430 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-770b3ef3-0cc1-4bed-88d9-c4cade9b9394 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:51.576047 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-770b3ef3-0cc1-4bed-88d9-c4cade9b9394 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:51.576688 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-770b3ef3-0cc1-4bed-88d9-c4cade9b9394 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:51.685992 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-770b3ef3-0cc1-4bed-88d9-c4cade9b9394 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:51.707066 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-770b3ef3-0cc1-4bed-88d9-c4cade9b9394 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1187 microversion: 2.1 time: 0.146358 Jul 29 05:28:51.720268 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 472/983] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:28:51 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1187 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:28:52.738473 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-7ae80871-7377-42b9-98dc-52e6b582a877 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:52.740668 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-7ae80871-7377-42b9-98dc-52e6b582a877 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:52.760822 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7ae80871-7377-42b9-98dc-52e6b582a877 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:52.761278 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7ae80871-7377-42b9-98dc-52e6b582a877 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:52.762953 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7ae80871-7377-42b9-98dc-52e6b582a877 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:52.763697 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7ae80871-7377-42b9-98dc-52e6b582a877 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:53.081202 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-7ae80871-7377-42b9-98dc-52e6b582a877 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:53.134018 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-7ae80871-7377-42b9-98dc-52e6b582a877 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1261 microversion: 2.1 time: 0.407028 Jul 29 05:28:53.135681 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 512/984] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:28:52 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1261 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:28:54.165647 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-b947b766-b86e-4d65-bbf4-54c07ac6bdad tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:54.182998 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-b947b766-b86e-4d65-bbf4-54c07ac6bdad tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:54.209215 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b947b766-b86e-4d65-bbf4-54c07ac6bdad tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:54.209718 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b947b766-b86e-4d65-bbf4-54c07ac6bdad tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:54.211464 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b947b766-b86e-4d65-bbf4-54c07ac6bdad tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:54.212780 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b947b766-b86e-4d65-bbf4-54c07ac6bdad tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:54.296343 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-12b46f24-e4d1-43e5-bad7-f5420cbb43e7 req-408bd8b6-e364-4e25-880f-5031f7f42b31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87eb34fa-b0bc-4ee0-aeea-70301f77125d", "tag": "f47132ea-cd5d-4836-887a-b486a4824db2"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:28:54.376387 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-12b46f24-e4d1-43e5-bad7-f5420cbb43e7 req-408bd8b6-e364-4e25-880f-5031f7f42b31 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:54.377233 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-12b46f24-e4d1-43e5-bad7-f5420cbb43e7 req-408bd8b6-e364-4e25-880f-5031f7f42b31 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:54.430319 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-12b46f24-e4d1-43e5-bad7-f5420cbb43e7 req-408bd8b6-e364-4e25-880f-5031f7f42b31 service nova] Creating event network-changed:f47132ea-cd5d-4836-887a-b486a4824db2 for instance 87eb34fa-b0bc-4ee0-aeea-70301f77125d on hv-cinder-85127 Jul 29 05:28:54.456749 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-12b46f24-e4d1-43e5-bad7-f5420cbb43e7 req-408bd8b6-e364-4e25-880f-5031f7f42b31 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164718 Jul 29 05:28:54.457828 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 513/985] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:28:54.792035 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-b947b766-b86e-4d65-bbf4-54c07ac6bdad tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:54.812580 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-4055b8c4-150d-4887-a790-d1f7d17976c5 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-588483382"}} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:28:54.813436 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-b947b766-b86e-4d65-bbf4-54c07ac6bdad tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1261 microversion: 2.1 time: 0.652806 Jul 29 05:28:54.813747 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-4055b8c4-150d-4887-a790-d1f7d17976c5 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:54.815619 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 473/986] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:28:54 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1261 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:28:54.826415 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4055b8c4-150d-4887-a790-d1f7d17976c5 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:54.832642 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4055b8c4-150d-4887-a790-d1f7d17976c5 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:54.835038 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4055b8c4-150d-4887-a790-d1f7d17976c5 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:54.838017 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4055b8c4-150d-4887-a790-d1f7d17976c5 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:55.550228 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.network.security_group_api [None req-4055b8c4-150d-4887-a790-d1f7d17976c5 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Removing security group e1e82250-30d0-4c5a-bdb8-bd9b19a7fcd6 from port 6d8585cd-d0d9-4ae4-9146-299c453184a4 Jul 29 05:28:55.862293 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-d58a1bff-e72c-4b6a-a92c-d2140e9581e0 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:55.863723 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-d58a1bff-e72c-4b6a-a92c-d2140e9581e0 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:55.873492 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d58a1bff-e72c-4b6a-a92c-d2140e9581e0 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:55.874353 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d58a1bff-e72c-4b6a-a92c-d2140e9581e0 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:55.876259 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d58a1bff-e72c-4b6a-a92c-d2140e9581e0 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:55.877989 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d58a1bff-e72c-4b6a-a92c-d2140e9581e0 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:56.281237 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-4055b8c4-150d-4887-a790-d1f7d17976c5 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "POST /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/action" status: 202 len: 0 microversion: 2.1 time: 1.474236 Jul 29 05:28:56.284801 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 514/987] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Jul 29 05:28:54 2022] POST /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/action => generated 0 bytes in 1479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 29 05:28:56.300572 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-905a9b19-5b0e-472b-a643-e846521b199c req-89574e7b-5cb8-4af6-8ca3-eb0e24422538 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8e59cc2-032c-497f-867c-2d5663a4da21", "tag": "6d8585cd-d0d9-4ae4-9146-299c453184a4"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:28:56.356577 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-d58a1bff-e72c-4b6a-a92c-d2140e9581e0 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:56.390362 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-905a9b19-5b0e-472b-a643-e846521b199c req-89574e7b-5cb8-4af6-8ca3-eb0e24422538 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:56.391207 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-905a9b19-5b0e-472b-a643-e846521b199c req-89574e7b-5cb8-4af6-8ca3-eb0e24422538 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:56.407419 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-d58a1bff-e72c-4b6a-a92c-d2140e9581e0 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1261 microversion: 2.1 time: 0.551057 Jul 29 05:28:56.410342 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 474/988] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:28:55 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1261 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:28:56.431953 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-905a9b19-5b0e-472b-a643-e846521b199c req-89574e7b-5cb8-4af6-8ca3-eb0e24422538 service nova] Creating event network-changed:6d8585cd-d0d9-4ae4-9146-299c453184a4 for instance a8e59cc2-032c-497f-867c-2d5663a4da21 on hv-cinder-85127 Jul 29 05:28:56.442083 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-905a9b19-5b0e-472b-a643-e846521b199c req-89574e7b-5cb8-4af6-8ca3-eb0e24422538 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150484 Jul 29 05:28:56.443227 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 515/989] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:28:57.441620 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-7cfb1c9e-18be-4e70-bfba-4b75986c0151 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:57.443390 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-7cfb1c9e-18be-4e70-bfba-4b75986c0151 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:57.459433 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7cfb1c9e-18be-4e70-bfba-4b75986c0151 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:57.460453 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7cfb1c9e-18be-4e70-bfba-4b75986c0151 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:57.462148 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7cfb1c9e-18be-4e70-bfba-4b75986c0151 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:57.463067 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7cfb1c9e-18be-4e70-bfba-4b75986c0151 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:57.778915 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-7cfb1c9e-18be-4e70-bfba-4b75986c0151 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:57.799837 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-7cfb1c9e-18be-4e70-bfba-4b75986c0151 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1261 microversion: 2.1 time: 0.371720 Jul 29 05:28:57.800326 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 475/990] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:28:57 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1261 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:28:58.780651 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-8eadcc85-2755-4b4c-91be-bc6b86e7fd7a tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:58.781259 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-8eadcc85-2755-4b4c-91be-bc6b86e7fd7a tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:58.789831 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-78b1f9db-643c-4528-a9d2-93d5cd85bd57 req-91166133-7a85-4294-92af-366c7fd4186d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8e59cc2-032c-497f-867c-2d5663a4da21", "tag": "6d8585cd-d0d9-4ae4-9146-299c453184a4"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:28:58.796585 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8eadcc85-2755-4b4c-91be-bc6b86e7fd7a tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:58.797932 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8eadcc85-2755-4b4c-91be-bc6b86e7fd7a tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:58.798769 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8eadcc85-2755-4b4c-91be-bc6b86e7fd7a tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:58.799246 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8eadcc85-2755-4b4c-91be-bc6b86e7fd7a tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:58.809300 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-78b1f9db-643c-4528-a9d2-93d5cd85bd57 req-91166133-7a85-4294-92af-366c7fd4186d service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:58.810089 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-78b1f9db-643c-4528-a9d2-93d5cd85bd57 req-91166133-7a85-4294-92af-366c7fd4186d service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:58.827199 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-78b1f9db-643c-4528-a9d2-93d5cd85bd57 req-91166133-7a85-4294-92af-366c7fd4186d service nova] Creating event network-changed:6d8585cd-d0d9-4ae4-9146-299c453184a4 for instance a8e59cc2-032c-497f-867c-2d5663a4da21 on hv-cinder-85127 Jul 29 05:28:58.834725 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-78b1f9db-643c-4528-a9d2-93d5cd85bd57 req-91166133-7a85-4294-92af-366c7fd4186d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054672 Jul 29 05:28:58.835774 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 476/991] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:28:58.842205 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-0b9cb388-a870-497d-87d8-be4f8c9f4542 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:58.843013 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-0b9cb388-a870-497d-87d8-be4f8c9f4542 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:58.850096 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0b9cb388-a870-497d-87d8-be4f8c9f4542 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:58.850569 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0b9cb388-a870-497d-87d8-be4f8c9f4542 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:58.851444 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0b9cb388-a870-497d-87d8-be4f8c9f4542 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:58.852094 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0b9cb388-a870-497d-87d8-be4f8c9f4542 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:58.962062 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.objects.instance [None req-8eadcc85-2755-4b4c-91be-bc6b86e7fd7a tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lazy-loading 'services' on Instance uuid a8e59cc2-032c-497f-867c-2d5663a4da21 {{(pid=117821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:28:59.132791 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-0b9cb388-a870-497d-87d8-be4f8c9f4542 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:28:59.153161 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-0b9cb388-a870-497d-87d8-be4f8c9f4542 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1261 microversion: 2.1 time: 0.315196 Jul 29 05:28:59.154198 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 477/992] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:28:58 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1261 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:28:59.194502 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-8eadcc85-2755-4b4c-91be-bc6b86e7fd7a tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/os-volume_attachments/03691a97-df08-4735-93e2-6a80a2183f9d" status: 202 len: 0 microversion: 2.1 time: 0.420634 Jul 29 05:28:59.195487 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 516/993] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Jul 29 05:28:58 2022] DELETE /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/os-volume_attachments/03691a97-df08-4735-93e2-6a80a2183f9d => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 05:28:59.204931 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-1e41ad4c-b8a7-4184-a547-90698b5648bd tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:28:59.207546 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-1e41ad4c-b8a7-4184-a547-90698b5648bd tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:28:59.215846 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1e41ad4c-b8a7-4184-a547-90698b5648bd tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:59.216316 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1e41ad4c-b8a7-4184-a547-90698b5648bd tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:59.217132 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1e41ad4c-b8a7-4184-a547-90698b5648bd tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:28:59.217579 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-1e41ad4c-b8a7-4184-a547-90698b5648bd tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:28:59.253400 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-1e41ad4c-b8a7-4184-a547-90698b5648bd tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053087 Jul 29 05:28:59.254652 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 478/994] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:28:59 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:29:00.185608 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-18a5bfac-3846-4780-a7cc-f2b8fa87cf81 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:00.186431 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-18a5bfac-3846-4780-a7cc-f2b8fa87cf81 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:00.203963 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-18a5bfac-3846-4780-a7cc-f2b8fa87cf81 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:00.205264 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-18a5bfac-3846-4780-a7cc-f2b8fa87cf81 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:00.209209 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-18a5bfac-3846-4780-a7cc-f2b8fa87cf81 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:00.210417 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-18a5bfac-3846-4780-a7cc-f2b8fa87cf81 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:00.267899 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-f1eeb0a8-9053-4404-83d1-64bf9138538c tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:00.270560 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-f1eeb0a8-9053-4404-83d1-64bf9138538c tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:00.286509 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell0:SELECT=2 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:29:00.289723 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell0:SELECT=6 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:29:00.294208 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f1eeb0a8-9053-4404-83d1-64bf9138538c tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:00.294772 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f1eeb0a8-9053-4404-83d1-64bf9138538c tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:00.295546 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f1eeb0a8-9053-4404-83d1-64bf9138538c tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:00.297155 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f1eeb0a8-9053-4404-83d1-64bf9138538c tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:00.354421 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-f1eeb0a8-9053-4404-83d1-64bf9138538c tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091484 Jul 29 05:29:00.355017 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 479/995] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:29:00 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:29:00.541246 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell0:SELECT=2 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:29:00.597628 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-18a5bfac-3846-4780-a7cc-f2b8fa87cf81 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:29:00.622951 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-18a5bfac-3846-4780-a7cc-f2b8fa87cf81 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1261 microversion: 2.1 time: 0.443207 Jul 29 05:29:00.625519 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 517/996] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:29:00 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1261 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:29:01.374096 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-ddb2f910-e713-4faa-85f9-8a0bfe2fe6b5 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:01.377980 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-ddb2f910-e713-4faa-85f9-8a0bfe2fe6b5 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:01.391087 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ddb2f910-e713-4faa-85f9-8a0bfe2fe6b5 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:01.391859 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ddb2f910-e713-4faa-85f9-8a0bfe2fe6b5 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:01.392926 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ddb2f910-e713-4faa-85f9-8a0bfe2fe6b5 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:01.393482 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ddb2f910-e713-4faa-85f9-8a0bfe2fe6b5 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:01.460385 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-ddb2f910-e713-4faa-85f9-8a0bfe2fe6b5 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095240 Jul 29 05:29:01.461435 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 480/997] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:29:01 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:29:01.649548 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-e7cd398c-95d9-473e-ab98-4e44df68bd37 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:01.651741 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-e7cd398c-95d9-473e-ab98-4e44df68bd37 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:01.666222 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e7cd398c-95d9-473e-ab98-4e44df68bd37 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:01.667499 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e7cd398c-95d9-473e-ab98-4e44df68bd37 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:01.672752 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e7cd398c-95d9-473e-ab98-4e44df68bd37 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:01.674473 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e7cd398c-95d9-473e-ab98-4e44df68bd37 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:02.035428 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-e7cd398c-95d9-473e-ab98-4e44df68bd37 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:29:02.059963 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-e7cd398c-95d9-473e-ab98-4e44df68bd37 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1261 microversion: 2.1 time: 0.417087 Jul 29 05:29:02.061176 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 518/998] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:29:01 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1261 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:29:02.478414 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-794114f2-5437-49fc-b6b0-aa60e58b11b2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:02.482684 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-794114f2-5437-49fc-b6b0-aa60e58b11b2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:02.494775 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-794114f2-5437-49fc-b6b0-aa60e58b11b2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:02.495534 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-794114f2-5437-49fc-b6b0-aa60e58b11b2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:02.498058 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-794114f2-5437-49fc-b6b0-aa60e58b11b2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:02.498790 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-794114f2-5437-49fc-b6b0-aa60e58b11b2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:02.543211 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-794114f2-5437-49fc-b6b0-aa60e58b11b2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071583 Jul 29 05:29:02.544044 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 481/999] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:29:02 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:29:03.082420 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-425fadca-a2d0-45f4-b419-36b4c9a08352 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:03.083102 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-425fadca-a2d0-45f4-b419-36b4c9a08352 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:03.090193 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-425fadca-a2d0-45f4-b419-36b4c9a08352 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:03.090642 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-425fadca-a2d0-45f4-b419-36b4c9a08352 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:03.091484 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-425fadca-a2d0-45f4-b419-36b4c9a08352 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:03.091914 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-425fadca-a2d0-45f4-b419-36b4c9a08352 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:03.310535 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-425fadca-a2d0-45f4-b419-36b4c9a08352 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:29:03.319000 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-425fadca-a2d0-45f4-b419-36b4c9a08352 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1261 microversion: 2.1 time: 0.240521 Jul 29 05:29:03.319661 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 519/1000] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:29:03 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1261 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:29:03.558419 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-ef4b36d7-6439-4851-a7d9-30abef2b8756 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:03.561354 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-ef4b36d7-6439-4851-a7d9-30abef2b8756 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:03.568647 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ef4b36d7-6439-4851-a7d9-30abef2b8756 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:03.569099 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ef4b36d7-6439-4851-a7d9-30abef2b8756 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:03.569939 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ef4b36d7-6439-4851-a7d9-30abef2b8756 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:03.570386 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ef4b36d7-6439-4851-a7d9-30abef2b8756 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:03.604541 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-ef4b36d7-6439-4851-a7d9-30abef2b8756 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050854 Jul 29 05:29:03.605143 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 482/1001] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:29:03 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:29:04.346108 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-503d2988-72ce-4af2-80df-c52f14ee200c tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:04.347307 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-503d2988-72ce-4af2-80df-c52f14ee200c tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:04.358963 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-503d2988-72ce-4af2-80df-c52f14ee200c tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:04.359812 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-503d2988-72ce-4af2-80df-c52f14ee200c tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:04.361062 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-503d2988-72ce-4af2-80df-c52f14ee200c tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:04.361823 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-503d2988-72ce-4af2-80df-c52f14ee200c tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:04.535222 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-503d2988-72ce-4af2-80df-c52f14ee200c tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:29:04.543785 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-503d2988-72ce-4af2-80df-c52f14ee200c tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1261 microversion: 2.1 time: 0.205479 Jul 29 05:29:04.544514 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 520/1002] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:29:04 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1261 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:29:04.622471 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-729f9f9b-9979-4fef-a462-d1555df016d0 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:04.624833 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-729f9f9b-9979-4fef-a462-d1555df016d0 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:04.631953 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-729f9f9b-9979-4fef-a462-d1555df016d0 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:04.632402 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-729f9f9b-9979-4fef-a462-d1555df016d0 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:04.633185 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-729f9f9b-9979-4fef-a462-d1555df016d0 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:04.633623 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-729f9f9b-9979-4fef-a462-d1555df016d0 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:04.668683 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-729f9f9b-9979-4fef-a462-d1555df016d0 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051498 Jul 29 05:29:04.669426 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 483/1003] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:29:04 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:29:05.577788 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-8f4545d9-69ab-4ee3-8bbe-a01cb45c33b2 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:05.578492 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-8f4545d9-69ab-4ee3-8bbe-a01cb45c33b2 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:05.586869 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8f4545d9-69ab-4ee3-8bbe-a01cb45c33b2 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:05.587735 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8f4545d9-69ab-4ee3-8bbe-a01cb45c33b2 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:05.589004 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8f4545d9-69ab-4ee3-8bbe-a01cb45c33b2 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:05.589646 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8f4545d9-69ab-4ee3-8bbe-a01cb45c33b2 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:05.686505 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-b024f594-a019-436c-8125-3bcac674d81f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:05.690260 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-b024f594-a019-436c-8125-3bcac674d81f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:05.700309 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b024f594-a019-436c-8125-3bcac674d81f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:05.701059 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b024f594-a019-436c-8125-3bcac674d81f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:05.702947 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b024f594-a019-436c-8125-3bcac674d81f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:05.703540 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b024f594-a019-436c-8125-3bcac674d81f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:05.737218 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-b024f594-a019-436c-8125-3bcac674d81f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058610 Jul 29 05:29:05.738243 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 484/1004] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:29:05 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:29:05.751910 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-8f4545d9-69ab-4ee3-8bbe-a01cb45c33b2 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:29:05.760076 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-8f4545d9-69ab-4ee3-8bbe-a01cb45c33b2 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1261 microversion: 2.1 time: 0.187181 Jul 29 05:29:05.760681 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 521/1005] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:29:05 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1261 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:29:06.753059 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-f1961bff-48c7-4f6d-a3fe-ed91d9ba32b2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:06.755170 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-f1961bff-48c7-4f6d-a3fe-ed91d9ba32b2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:06.762868 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f1961bff-48c7-4f6d-a3fe-ed91d9ba32b2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:06.763266 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f1961bff-48c7-4f6d-a3fe-ed91d9ba32b2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:06.764081 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f1961bff-48c7-4f6d-a3fe-ed91d9ba32b2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:06.764534 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f1961bff-48c7-4f6d-a3fe-ed91d9ba32b2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:06.768772 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell1:SELECT=100 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:29:06.783369 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-e1e24b7a-a56f-4bc3-a0eb-8ed2bd74464d tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:06.783977 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-e1e24b7a-a56f-4bc3-a0eb-8ed2bd74464d tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:06.790927 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e1e24b7a-a56f-4bc3-a0eb-8ed2bd74464d tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:06.791405 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e1e24b7a-a56f-4bc3-a0eb-8ed2bd74464d tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:06.792216 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e1e24b7a-a56f-4bc3-a0eb-8ed2bd74464d tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:06.792954 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e1e24b7a-a56f-4bc3-a0eb-8ed2bd74464d tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:06.800115 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-f1961bff-48c7-4f6d-a3fe-ed91d9ba32b2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051059 Jul 29 05:29:06.800898 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 485/1006] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:29:06 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:29:06.937383 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-e1e24b7a-a56f-4bc3-a0eb-8ed2bd74464d tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:29:06.953124 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-e1e24b7a-a56f-4bc3-a0eb-8ed2bd74464d tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1261 microversion: 2.1 time: 0.173316 Jul 29 05:29:06.954208 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 522/1007] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:29:06 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1261 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:29:07.813799 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-46138ded-319d-405a-8ffc-32dd192a0da7 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:07.816212 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-46138ded-319d-405a-8ffc-32dd192a0da7 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:07.823247 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-46138ded-319d-405a-8ffc-32dd192a0da7 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:07.823749 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-46138ded-319d-405a-8ffc-32dd192a0da7 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:07.825493 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-46138ded-319d-405a-8ffc-32dd192a0da7 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:07.825978 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-46138ded-319d-405a-8ffc-32dd192a0da7 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:07.861369 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-46138ded-319d-405a-8ffc-32dd192a0da7 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051858 Jul 29 05:29:07.862098 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 486/1008] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:29:07 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:29:07.975403 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-f7d3f53d-9d16-4298-a1c7-6011de17bd54 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:07.976438 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-f7d3f53d-9d16-4298-a1c7-6011de17bd54 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:07.984246 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f7d3f53d-9d16-4298-a1c7-6011de17bd54 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:07.984700 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f7d3f53d-9d16-4298-a1c7-6011de17bd54 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:07.985508 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f7d3f53d-9d16-4298-a1c7-6011de17bd54 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:07.985952 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f7d3f53d-9d16-4298-a1c7-6011de17bd54 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:08.157100 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-f7d3f53d-9d16-4298-a1c7-6011de17bd54 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:29:08.170409 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-f7d3f53d-9d16-4298-a1c7-6011de17bd54 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1261 microversion: 2.1 time: 0.198606 Jul 29 05:29:08.171718 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 523/1009] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:29:07 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1261 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:29:08.875151 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-9c2d0b44-9002-4106-b9f0-898b9202e9a2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:08.877366 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-9c2d0b44-9002-4106-b9f0-898b9202e9a2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:08.885528 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9c2d0b44-9002-4106-b9f0-898b9202e9a2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:08.887147 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9c2d0b44-9002-4106-b9f0-898b9202e9a2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:08.888404 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9c2d0b44-9002-4106-b9f0-898b9202e9a2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:08.889223 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9c2d0b44-9002-4106-b9f0-898b9202e9a2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:08.930503 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-9c2d0b44-9002-4106-b9f0-898b9202e9a2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060014 Jul 29 05:29:08.931366 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 487/1010] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:29:08 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:29:09.198937 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-a4e78fa3-bd69-4411-82b4-c89a610ea2c1 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:09.199835 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-a4e78fa3-bd69-4411-82b4-c89a610ea2c1 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:09.207480 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a4e78fa3-bd69-4411-82b4-c89a610ea2c1 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:09.208051 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a4e78fa3-bd69-4411-82b4-c89a610ea2c1 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:09.208998 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a4e78fa3-bd69-4411-82b4-c89a610ea2c1 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:09.209492 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a4e78fa3-bd69-4411-82b4-c89a610ea2c1 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:09.232139 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:29:09.381460 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-a4e78fa3-bd69-4411-82b4-c89a610ea2c1 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:29:09.389929 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-a4e78fa3-bd69-4411-82b4-c89a610ea2c1 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1261 microversion: 2.1 time: 0.195395 Jul 29 05:29:09.390527 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 524/1011] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:29:09 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1261 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:29:09.944405 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-ad812b3c-d9d9-4d47-b5cc-016f4fb4b173 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:09.946577 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-ad812b3c-d9d9-4d47-b5cc-016f4fb4b173 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:09.954041 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ad812b3c-d9d9-4d47-b5cc-016f4fb4b173 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:09.954494 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ad812b3c-d9d9-4d47-b5cc-016f4fb4b173 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:09.955273 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ad812b3c-d9d9-4d47-b5cc-016f4fb4b173 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:09.955737 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ad812b3c-d9d9-4d47-b5cc-016f4fb4b173 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:09.988055 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-ad812b3c-d9d9-4d47-b5cc-016f4fb4b173 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047570 Jul 29 05:29:09.988622 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 488/1012] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:29:09 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:29:10.413323 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-cf6ec3c2-3728-43f0-ab0c-cb8d38e1c75b tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:10.413323 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-cf6ec3c2-3728-43f0-ab0c-cb8d38e1c75b tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:10.419696 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-cf6ec3c2-3728-43f0-ab0c-cb8d38e1c75b tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:10.420152 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-cf6ec3c2-3728-43f0-ab0c-cb8d38e1c75b tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:10.420918 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-cf6ec3c2-3728-43f0-ab0c-cb8d38e1c75b tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:10.421357 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-cf6ec3c2-3728-43f0-ab0c-cb8d38e1c75b tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:10.566956 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-cf6ec3c2-3728-43f0-ab0c-cb8d38e1c75b tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:29:10.576010 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-cf6ec3c2-3728-43f0-ab0c-cb8d38e1c75b tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1261 microversion: 2.1 time: 0.167276 Jul 29 05:29:10.576597 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 525/1013] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:29:10 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1261 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:29:11.002769 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-01a76155-a853-4a78-b644-0a4af33013d3 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:11.005700 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-01a76155-a853-4a78-b644-0a4af33013d3 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:11.014210 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-01a76155-a853-4a78-b644-0a4af33013d3 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:11.014656 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-01a76155-a853-4a78-b644-0a4af33013d3 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:11.015459 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-01a76155-a853-4a78-b644-0a4af33013d3 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:11.015892 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-01a76155-a853-4a78-b644-0a4af33013d3 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:11.048969 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-01a76155-a853-4a78-b644-0a4af33013d3 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051375 Jul 29 05:29:11.049543 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 489/1014] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:29:10 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:29:11.596425 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-eb6d1b80-4e2b-415e-8db4-31c61ffe3124 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:11.596953 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-eb6d1b80-4e2b-415e-8db4-31c61ffe3124 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:11.603580 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-eb6d1b80-4e2b-415e-8db4-31c61ffe3124 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:11.604036 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-eb6d1b80-4e2b-415e-8db4-31c61ffe3124 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:11.605412 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-eb6d1b80-4e2b-415e-8db4-31c61ffe3124 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:11.605867 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-eb6d1b80-4e2b-415e-8db4-31c61ffe3124 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:11.743810 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-eb6d1b80-4e2b-415e-8db4-31c61ffe3124 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:29:11.752224 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-eb6d1b80-4e2b-415e-8db4-31c61ffe3124 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1261 microversion: 2.1 time: 0.159706 Jul 29 05:29:11.752837 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 526/1015] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:29:11 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:29:12.063083 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-abf77e0d-3564-4c2b-8172-aa9fd1d69227 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:12.066197 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-abf77e0d-3564-4c2b-8172-aa9fd1d69227 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:12.072711 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-abf77e0d-3564-4c2b-8172-aa9fd1d69227 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:12.073162 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-abf77e0d-3564-4c2b-8172-aa9fd1d69227 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:12.074571 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-abf77e0d-3564-4c2b-8172-aa9fd1d69227 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:12.075003 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-abf77e0d-3564-4c2b-8172-aa9fd1d69227 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:12.107470 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-abf77e0d-3564-4c2b-8172-aa9fd1d69227 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049831 Jul 29 05:29:12.108037 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 490/1016] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:29:12 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:29:12.773814 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-64535057-6ff3-4871-b5ea-2305f30fe136 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:12.774774 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-64535057-6ff3-4871-b5ea-2305f30fe136 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:12.782623 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-64535057-6ff3-4871-b5ea-2305f30fe136 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:12.783111 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-64535057-6ff3-4871-b5ea-2305f30fe136 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:12.783939 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-64535057-6ff3-4871-b5ea-2305f30fe136 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:12.784385 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-64535057-6ff3-4871-b5ea-2305f30fe136 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:12.942522 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-64535057-6ff3-4871-b5ea-2305f30fe136 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:29:12.951497 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-64535057-6ff3-4871-b5ea-2305f30fe136 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1261 microversion: 2.1 time: 0.181674 Jul 29 05:29:12.952102 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 527/1017] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:29:12 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1261 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:29:13.120014 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-dd2e5ad9-dd54-4a99-89b0-3c7d6d01e187 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:13.123559 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-dd2e5ad9-dd54-4a99-89b0-3c7d6d01e187 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:13.125970 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:29:13.133011 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-dd2e5ad9-dd54-4a99-89b0-3c7d6d01e187 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:13.133467 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-dd2e5ad9-dd54-4a99-89b0-3c7d6d01e187 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:13.134250 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-dd2e5ad9-dd54-4a99-89b0-3c7d6d01e187 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:13.134684 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-dd2e5ad9-dd54-4a99-89b0-3c7d6d01e187 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:13.166997 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-dd2e5ad9-dd54-4a99-89b0-3c7d6d01e187 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051076 Jul 29 05:29:13.168764 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 491/1018] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:29:13 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:29:13.976672 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-2fa88546-44e3-4df0-8c74-e171102d0b63 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:13.979388 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-2fa88546-44e3-4df0-8c74-e171102d0b63 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:13.992613 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:29:14.016699 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2fa88546-44e3-4df0-8c74-e171102d0b63 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:14.017755 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2fa88546-44e3-4df0-8c74-e171102d0b63 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:14.019196 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2fa88546-44e3-4df0-8c74-e171102d0b63 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:14.019896 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-2fa88546-44e3-4df0-8c74-e171102d0b63 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:14.181661 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-e3040a42-edac-4080-9475-2bc359509882 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:14.185425 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-e3040a42-edac-4080-9475-2bc359509882 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:14.201614 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e3040a42-edac-4080-9475-2bc359509882 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:14.202173 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e3040a42-edac-4080-9475-2bc359509882 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:14.202994 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e3040a42-edac-4080-9475-2bc359509882 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:14.203458 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e3040a42-edac-4080-9475-2bc359509882 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:14.259056 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-e3040a42-edac-4080-9475-2bc359509882 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.082035 Jul 29 05:29:14.259983 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 492/1019] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 05:29:14 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 05:29:14.285903 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-ba8856d7-039c-4570-8e26-15efca0d2cf2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:14.286652 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-ba8856d7-039c-4570-8e26-15efca0d2cf2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:14.299855 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ba8856d7-039c-4570-8e26-15efca0d2cf2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:14.301075 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ba8856d7-039c-4570-8e26-15efca0d2cf2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:14.301996 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ba8856d7-039c-4570-8e26-15efca0d2cf2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:14.302442 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ba8856d7-039c-4570-8e26-15efca0d2cf2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:14.326105 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-2fa88546-44e3-4df0-8c74-e171102d0b63 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:29:14.342603 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-2fa88546-44e3-4df0-8c74-e171102d0b63 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1261 microversion: 2.1 time: 0.372715 Jul 29 05:29:14.343542 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 528/1020] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:29:13 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1261 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:29:14.587874 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.wsgi [None req-ba8856d7-039c-4570-8e26-15efca0d2cf2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] HTTP exception thrown: Instance a8e59cc2-032c-497f-867c-2d5663a4da21 is not attached to volume 03691a97-df08-4735-93e2-6a80a2183f9d Jul 29 05:29:14.590899 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-ba8856d7-039c-4570-8e26-15efca0d2cf2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Request method failure captured: Jul 29 05:29:14.590899 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: request: DELETE /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/os-volume_attachments/03691a97-df08-4735-93e2-6a80a2183f9d HTTP/1.1 Jul 29 05:29:14.590899 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept: application/json Jul 29 05:29:14.590899 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept-Encoding: identity Jul 29 05:29:14.590899 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Connection: close Jul 29 05:29:14.590899 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Length: 0 Jul 29 05:29:14.590899 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Type: application/json Jul 29 05:29:14.590899 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Host: 10.222.0.49 Jul 29 05:29:14.590899 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Openstack-System-Scope: None Jul 29 05:29:14.590899 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: User-Agent: python-urllib3/1.26.10 Jul 29 05:29:14.590899 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Auth-Token: gAAAAABi42-BfLvAq_u_fYBpdaue-gHbkekMVVSVSj-XQ-pq4O9HDjfpyM-N8ziHsidurodQrRBW-8e5W5oSsgal-yms4veuKHqDxT6yxo4PqrVYnP6pDcHncnJwBjnUT9OelMCqf3ezNa0_lyN0f2uoh9HX1Jg3cUm-7Py48NA2UUr2DXmSKkE Jul 29 05:29:14.590899 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Id: None Jul 29 05:29:14.590899 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Name: None Jul 29 05:29:14.590899 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Identity-Status: Confirmed Jul 29 05:29:14.590899 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Is-Admin-Project: True Jul 29 05:29:14.590899 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Id: default Jul 29 05:29:14.590899 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Name: Default Jul 29 05:29:14.590899 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Id: 4c28b78169ac49a6854f195bea0dd9bf Jul 29 05:29:14.590899 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Name: tempest-TestMinimumBasicScenario-125101285 Jul 29 05:29:14.590899 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Role: member,reader Jul 29 05:29:14.590899 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Roles: member,reader Jul 29 05:29:14.592497 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4c28b78169ac49a6854f195bea0dd9bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4c28b78169ac49a6854f195bea0dd9bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4c28b78169ac49a6854f195bea0dd9bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4c28b78169ac49a6854f195bea0dd9bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:29:14.592497 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant: tempest-TestMinimumBasicScenario-125101285 Jul 29 05:29:14.592497 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Id: 4c28b78169ac49a6854f195bea0dd9bf Jul 29 05:29:14.592497 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Name: tempest-TestMinimumBasicScenario-125101285 Jul 29 05:29:14.592497 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User: tempest-TestMinimumBasicScenario-125101285-project Jul 29 05:29:14.592497 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Id: default Jul 29 05:29:14.592497 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Name: Default Jul 29 05:29:14.592497 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Id: 190f6130be544a73bb619f7b49ab4e87 Jul 29 05:29:14.592497 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Name: tempest-TestMinimumBasicScenario-125101285-project Jul 29 05:29:14.592497 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: method: > Jul 29 05:29:14.592497 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: exception: Instance a8e59cc2-032c-497f-867c-2d5663a4da21 is not attached to volume 03691a97-df08-4735-93e2-6a80a2183f9d Jul 29 05:29:14.593272 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: action_args: {'server_id': 'a8e59cc2-032c-497f-867c-2d5663a4da21', 'id': '03691a97-df08-4735-93e2-6a80a2183f9d'} Jul 29 05:29:14.593272 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:29:14.593272 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:29:14.593272 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 29 05:29:14.593272 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 29 05:29:14.593272 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 05:29:14.593272 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 05:29:14.593272 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 29 05:29:14.593272 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 29 05:29:14.593272 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 03691a97-df08-4735-93e2-6a80a2183f9d. Jul 29 05:29:14.593272 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:29:14.593272 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:29:14.593272 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:29:14.593272 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:29:14.593272 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:29:14.593272 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:29:14.593272 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:29:14.593272 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:29:14.593272 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:29:14.594649 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:29:14.594649 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 29 05:29:14.594649 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 29 05:29:14.594649 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8e59cc2-032c-497f-867c-2d5663a4da21 is not attached to volume 03691a97-df08-4735-93e2-6a80a2183f9d Jul 29 05:29:14.594649 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:29:14.594649 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:29:14.594649 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:29:14.594649 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:29:14.594649 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:29:14.594649 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:29:14.594649 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:29:14.594649 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:29:14.594649 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8e59cc2-032c-497f-867c-2d5663a4da21 is not attached to volume 03691a97-df08-4735-93e2-6a80a2183f9d Jul 29 05:29:14.594649 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:29:14.595713 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-ba8856d7-039c-4570-8e26-15efca0d2cf2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Returning 404 to user: Instance a8e59cc2-032c-497f-867c-2d5663a4da21 is not attached to volume 03691a97-df08-4735-93e2-6a80a2183f9d {{(pid=117820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:29:14.595713 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-ba8856d7-039c-4570-8e26-15efca0d2cf2 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/os-volume_attachments/03691a97-df08-4735-93e2-6a80a2183f9d" status: 404 len: 154 microversion: 2.1 time: 0.316195 Jul 29 05:29:14.602633 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 493/1021] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Jul 29 05:29:14 2022] DELETE /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21/os-volume_attachments/03691a97-df08-4735-93e2-6a80a2183f9d => generated 154 bytes in 320 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:29:15.371288 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-f30b3b63-eb5d-4c46-9568-9f0ff70a080e tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:15.372237 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-f30b3b63-eb5d-4c46-9568-9f0ff70a080e tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:15.379703 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f30b3b63-eb5d-4c46-9568-9f0ff70a080e tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:15.380155 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f30b3b63-eb5d-4c46-9568-9f0ff70a080e tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:15.380945 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f30b3b63-eb5d-4c46-9568-9f0ff70a080e tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:15.381374 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f30b3b63-eb5d-4c46-9568-9f0ff70a080e tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:15.588747 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-f30b3b63-eb5d-4c46-9568-9f0ff70a080e tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:29:15.628132 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-f30b3b63-eb5d-4c46-9568-9f0ff70a080e tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1261 microversion: 2.1 time: 0.261938 Jul 29 05:29:15.634801 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 529/1022] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:29:15 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1261 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:29:16.651475 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-23bbb326-5e7b-4a68-b127-648e2f8f8de1 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:16.652536 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-23bbb326-5e7b-4a68-b127-648e2f8f8de1 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:16.661574 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-23bbb326-5e7b-4a68-b127-648e2f8f8de1 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:16.662311 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-23bbb326-5e7b-4a68-b127-648e2f8f8de1 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:16.663109 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-23bbb326-5e7b-4a68-b127-648e2f8f8de1 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:16.663584 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-23bbb326-5e7b-4a68-b127-648e2f8f8de1 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:16.861804 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-23bbb326-5e7b-4a68-b127-648e2f8f8de1 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:29:16.870726 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-23bbb326-5e7b-4a68-b127-648e2f8f8de1 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1261 microversion: 2.1 time: 0.223222 Jul 29 05:29:16.871738 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 494/1023] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:29:16 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1261 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:29:17.900692 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-57bb83a9-560d-41f3-87d7-fe9c48a55f05 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:17.902886 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-57bb83a9-560d-41f3-87d7-fe9c48a55f05 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:17.915012 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-57bb83a9-560d-41f3-87d7-fe9c48a55f05 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:17.916182 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-57bb83a9-560d-41f3-87d7-fe9c48a55f05 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:17.918341 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-57bb83a9-560d-41f3-87d7-fe9c48a55f05 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:17.919536 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-57bb83a9-560d-41f3-87d7-fe9c48a55f05 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:18.254546 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-57bb83a9-560d-41f3-87d7-fe9c48a55f05 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:29:18.264504 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-57bb83a9-560d-41f3-87d7-fe9c48a55f05 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1261 microversion: 2.1 time: 0.373183 Jul 29 05:29:18.266443 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 530/1024] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:29:17 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1261 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:29:19.014589 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-b3e823e3-dd56-4f8e-b3a0-31e69269d532 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:19.015549 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-b3e823e3-dd56-4f8e-b3a0-31e69269d532 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:19.022706 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b3e823e3-dd56-4f8e-b3a0-31e69269d532 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:19.023695 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b3e823e3-dd56-4f8e-b3a0-31e69269d532 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:19.024602 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b3e823e3-dd56-4f8e-b3a0-31e69269d532 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:19.025144 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b3e823e3-dd56-4f8e-b3a0-31e69269d532 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:19.058956 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-b3e823e3-dd56-4f8e-b3a0-31e69269d532 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Going to try to terminate instance {{(pid=117820) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 05:29:19.174509 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-b3e823e3-dd56-4f8e-b3a0-31e69269d532 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 204 len: 0 microversion: 2.1 time: 0.165174 Jul 29 05:29:19.176010 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 495/1025] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 05:29:19 2022] DELETE /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 29 05:29:19.200755 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-73e66070-eb77-41f7-9e51-65925a8bc9fe tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:19.201383 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-73e66070-eb77-41f7-9e51-65925a8bc9fe tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:19.210973 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-73e66070-eb77-41f7-9e51-65925a8bc9fe tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:19.211673 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-73e66070-eb77-41f7-9e51-65925a8bc9fe tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:19.212569 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-73e66070-eb77-41f7-9e51-65925a8bc9fe tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:19.213356 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-73e66070-eb77-41f7-9e51-65925a8bc9fe tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:19.303045 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-92177188-e442-42c3-9b1a-8875ed0f598d tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:19.304120 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-92177188-e442-42c3-9b1a-8875ed0f598d tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:19.317341 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-92177188-e442-42c3-9b1a-8875ed0f598d tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:19.318244 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-92177188-e442-42c3-9b1a-8875ed0f598d tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:19.319327 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-92177188-e442-42c3-9b1a-8875ed0f598d tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:19.322413 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-92177188-e442-42c3-9b1a-8875ed0f598d tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:19.432021 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-73e66070-eb77-41f7-9e51-65925a8bc9fe tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:29:19.445637 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-73e66070-eb77-41f7-9e51-65925a8bc9fe tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1554 microversion: 2.1 time: 0.264219 Jul 29 05:29:19.459380 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 531/1026] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:29:19 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1554 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:29:19.459380 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-033b8dcf-83a9-403f-9be9-6321e5ca820d req-673fd5a8-c4d7-403a-8c79-760537d68a27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87eb34fa-b0bc-4ee0-aeea-70301f77125d", "name": "network-vif-plugged", "status": "completed", "tag": "f47132ea-cd5d-4836-887a-b486a4824db2"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:29:19.465201 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-033b8dcf-83a9-403f-9be9-6321e5ca820d req-673fd5a8-c4d7-403a-8c79-760537d68a27 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:19.466023 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-033b8dcf-83a9-403f-9be9-6321e5ca820d req-673fd5a8-c4d7-403a-8c79-760537d68a27 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:19.481081 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-033b8dcf-83a9-403f-9be9-6321e5ca820d req-673fd5a8-c4d7-403a-8c79-760537d68a27 service nova] Creating event network-vif-plugged:f47132ea-cd5d-4836-887a-b486a4824db2 for instance 87eb34fa-b0bc-4ee0-aeea-70301f77125d on hv-cinder-85127 Jul 29 05:29:19.487690 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-033b8dcf-83a9-403f-9be9-6321e5ca820d req-673fd5a8-c4d7-403a-8c79-760537d68a27 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039706 Jul 29 05:29:19.488291 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 532/1027] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:29:19.553749 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-92177188-e442-42c3-9b1a-8875ed0f598d tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:29:19.562903 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-92177188-e442-42c3-9b1a-8875ed0f598d tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1261 microversion: 2.1 time: 0.266431 Jul 29 05:29:19.563621 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 496/1028] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:29:19 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1261 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:29:20.477534 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-d595cf81-e83d-451b-881d-ed9248f63d7f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:20.478242 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-d595cf81-e83d-451b-881d-ed9248f63d7f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:20.487000 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d595cf81-e83d-451b-881d-ed9248f63d7f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:20.487479 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d595cf81-e83d-451b-881d-ed9248f63d7f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:20.488482 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d595cf81-e83d-451b-881d-ed9248f63d7f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:20.488884 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d595cf81-e83d-451b-881d-ed9248f63d7f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:20.590053 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-29935f2a-f733-47f9-a5de-4191351269d8 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:20.590698 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-29935f2a-f733-47f9-a5de-4191351269d8 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:20.603408 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-29935f2a-f733-47f9-a5de-4191351269d8 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:20.603823 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-29935f2a-f733-47f9-a5de-4191351269d8 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:20.606473 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-29935f2a-f733-47f9-a5de-4191351269d8 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:20.606907 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-29935f2a-f733-47f9-a5de-4191351269d8 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:20.702281 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-d595cf81-e83d-451b-881d-ed9248f63d7f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:29:20.712305 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-d595cf81-e83d-451b-881d-ed9248f63d7f tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1554 microversion: 2.1 time: 0.239760 Jul 29 05:29:20.712737 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 533/1029] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:29:20 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1554 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:29:20.799043 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-29935f2a-f733-47f9-a5de-4191351269d8 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:29:20.812999 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-29935f2a-f733-47f9-a5de-4191351269d8 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1261 microversion: 2.1 time: 0.227749 Jul 29 05:29:20.814055 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 497/1030] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:29:20 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1261 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:29:21.747275 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-23df14aa-6cf3-41fa-bf74-6459e3115f90 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:21.747852 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-23df14aa-6cf3-41fa-bf74-6459e3115f90 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:21.754936 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-23df14aa-6cf3-41fa-bf74-6459e3115f90 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:21.755443 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-23df14aa-6cf3-41fa-bf74-6459e3115f90 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:21.756239 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-23df14aa-6cf3-41fa-bf74-6459e3115f90 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:21.756682 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-23df14aa-6cf3-41fa-bf74-6459e3115f90 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:21.847827 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-a2104072-35d7-407c-b10f-9f36299cbc93 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:21.849044 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-a2104072-35d7-407c-b10f-9f36299cbc93 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:21.856862 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a2104072-35d7-407c-b10f-9f36299cbc93 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:21.857873 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a2104072-35d7-407c-b10f-9f36299cbc93 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:21.858826 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a2104072-35d7-407c-b10f-9f36299cbc93 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:21.859391 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a2104072-35d7-407c-b10f-9f36299cbc93 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:21.921806 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-23df14aa-6cf3-41fa-bf74-6459e3115f90 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:29:21.930280 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-23df14aa-6cf3-41fa-bf74-6459e3115f90 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1554 microversion: 2.1 time: 0.187913 Jul 29 05:29:21.931053 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 534/1031] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:29:21 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1554 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:29:22.025770 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-a2104072-35d7-407c-b10f-9f36299cbc93 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:29:22.033967 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-a2104072-35d7-407c-b10f-9f36299cbc93 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1261 microversion: 2.1 time: 0.190419 Jul 29 05:29:22.034658 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 498/1032] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:29:21 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1261 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:29:22.954469 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-17fd803d-0a68-40a3-b5fc-ad80a318dc15 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:22.955327 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-17fd803d-0a68-40a3-b5fc-ad80a318dc15 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:22.963303 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-17fd803d-0a68-40a3-b5fc-ad80a318dc15 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:22.964120 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-17fd803d-0a68-40a3-b5fc-ad80a318dc15 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:22.965119 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-17fd803d-0a68-40a3-b5fc-ad80a318dc15 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:22.965678 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-17fd803d-0a68-40a3-b5fc-ad80a318dc15 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:23.058189 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-b05d615d-8eb8-4e2d-a185-1c39dfa60d34 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:23.059233 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-b05d615d-8eb8-4e2d-a185-1c39dfa60d34 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:23.070571 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b05d615d-8eb8-4e2d-a185-1c39dfa60d34 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:23.071582 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b05d615d-8eb8-4e2d-a185-1c39dfa60d34 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:23.073505 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b05d615d-8eb8-4e2d-a185-1c39dfa60d34 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:23.074307 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b05d615d-8eb8-4e2d-a185-1c39dfa60d34 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:23.208762 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-17fd803d-0a68-40a3-b5fc-ad80a318dc15 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:29:23.218870 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-17fd803d-0a68-40a3-b5fc-ad80a318dc15 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1554 microversion: 2.1 time: 0.269105 Jul 29 05:29:23.219979 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 535/1033] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:29:22 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1554 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:29:23.415404 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-b05d615d-8eb8-4e2d-a185-1c39dfa60d34 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:29:23.427039 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-b05d615d-8eb8-4e2d-a185-1c39dfa60d34 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1261 microversion: 2.1 time: 0.373840 Jul 29 05:29:23.427749 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 499/1034] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:29:23 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1261 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:29:23.758443 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-4a407fa6-369d-409d-8267-1374f2b9ce47 req-f82a7a43-0312-4062-bbbb-4593b57a2c52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8e59cc2-032c-497f-867c-2d5663a4da21", "name": "network-vif-deleted", "tag": "6d8585cd-d0d9-4ae4-9146-299c453184a4"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:29:23.770645 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-4a407fa6-369d-409d-8267-1374f2b9ce47 req-f82a7a43-0312-4062-bbbb-4593b57a2c52 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:23.771243 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-4a407fa6-369d-409d-8267-1374f2b9ce47 req-f82a7a43-0312-4062-bbbb-4593b57a2c52 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:23.785207 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-4a407fa6-369d-409d-8267-1374f2b9ce47 req-f82a7a43-0312-4062-bbbb-4593b57a2c52 service nova] Creating event network-vif-deleted:6d8585cd-d0d9-4ae4-9146-299c453184a4 for instance a8e59cc2-032c-497f-867c-2d5663a4da21 on hv-cinder-85127 Jul 29 05:29:23.790671 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-4a407fa6-369d-409d-8267-1374f2b9ce47 req-f82a7a43-0312-4062-bbbb-4593b57a2c52 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036193 Jul 29 05:29:23.791315 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 536/1035] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:29:24.251077 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-f2dd230e-79c9-4994-a13f-442313b0a0f1 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:24.252386 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-f2dd230e-79c9-4994-a13f-442313b0a0f1 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:24.288626 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f2dd230e-79c9-4994-a13f-442313b0a0f1 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:24.290316 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f2dd230e-79c9-4994-a13f-442313b0a0f1 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:24.293002 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f2dd230e-79c9-4994-a13f-442313b0a0f1 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:24.293967 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f2dd230e-79c9-4994-a13f-442313b0a0f1 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:24.301443 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:29:24.400509 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f2dd230e-79c9-4994-a13f-442313b0a0f1 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:24.401356 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f2dd230e-79c9-4994-a13f-442313b0a0f1 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:24.402114 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.objects.instance [None req-f2dd230e-79c9-4994-a13f-442313b0a0f1 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lazy-loading 'fault' on Instance uuid a8e59cc2-032c-497f-867c-2d5663a4da21 {{(pid=117820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:29:24.454115 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-cf88c72a-b970-41b1-99e7-d34e88fcc44c tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:24.455256 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-cf88c72a-b970-41b1-99e7-d34e88fcc44c tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:24.462994 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-f2dd230e-79c9-4994-a13f-442313b0a0f1 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:29:24.467321 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-cf88c72a-b970-41b1-99e7-d34e88fcc44c tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:24.468538 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-cf88c72a-b970-41b1-99e7-d34e88fcc44c tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:24.469955 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-cf88c72a-b970-41b1-99e7-d34e88fcc44c tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:24.471007 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-cf88c72a-b970-41b1-99e7-d34e88fcc44c tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:24.472546 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-f2dd230e-79c9-4994-a13f-442313b0a0f1 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1348 microversion: 2.1 time: 0.231930 Jul 29 05:29:24.486376 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 500/1036] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:29:24 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1348 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:29:24.669851 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-cf88c72a-b970-41b1-99e7-d34e88fcc44c tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:29:24.685270 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-cf88c72a-b970-41b1-99e7-d34e88fcc44c tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1445 microversion: 2.1 time: 0.237871 Jul 29 05:29:24.686310 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 537/1037] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:29:24 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1445 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:29:24.707570 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-7ab66536-cce7-4ec7-961c-b333440178aa tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:24.708192 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-7ab66536-cce7-4ec7-961c-b333440178aa tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:24.717250 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7ab66536-cce7-4ec7-961c-b333440178aa tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:24.718320 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7ab66536-cce7-4ec7-961c-b333440178aa tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:24.719400 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7ab66536-cce7-4ec7-961c-b333440178aa tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:24.720045 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7ab66536-cce7-4ec7-961c-b333440178aa tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:24.878956 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-7ab66536-cce7-4ec7-961c-b333440178aa tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:29:24.887442 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-7ab66536-cce7-4ec7-961c-b333440178aa tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1445 microversion: 2.1 time: 0.183688 Jul 29 05:29:24.888031 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 501/1038] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:29:24 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1445 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:29:25.503597 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-26215d24-b2c7-407c-8f66-083f4d0527b7 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:25.504673 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-26215d24-b2c7-407c-8f66-083f4d0527b7 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:25.514022 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-26215d24-b2c7-407c-8f66-083f4d0527b7 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:25.514643 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-26215d24-b2c7-407c-8f66-083f4d0527b7 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:25.515866 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-26215d24-b2c7-407c-8f66-083f4d0527b7 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:25.516699 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-26215d24-b2c7-407c-8f66-083f4d0527b7 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:25.584018 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-26215d24-b2c7-407c-8f66-083f4d0527b7 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:25.584477 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-26215d24-b2c7-407c-8f66-083f4d0527b7 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:25.585284 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.objects.instance [None req-26215d24-b2c7-407c-8f66-083f4d0527b7 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lazy-loading 'fault' on Instance uuid a8e59cc2-032c-497f-867c-2d5663a4da21 {{(pid=117821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:29:25.639137 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-26215d24-b2c7-407c-8f66-083f4d0527b7 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:29:25.647332 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-26215d24-b2c7-407c-8f66-083f4d0527b7 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1348 microversion: 2.1 time: 0.151037 Jul 29 05:29:25.647985 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 538/1039] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:29:25 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1348 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:29:26.673489 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-577f3f2d-2360-4fa4-a60f-959cb1f5dbe8 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:26.674492 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-577f3f2d-2360-4fa4-a60f-959cb1f5dbe8 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:26.683685 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-577f3f2d-2360-4fa4-a60f-959cb1f5dbe8 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:26.684152 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-577f3f2d-2360-4fa4-a60f-959cb1f5dbe8 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:26.684966 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-577f3f2d-2360-4fa4-a60f-959cb1f5dbe8 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:26.685408 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-577f3f2d-2360-4fa4-a60f-959cb1f5dbe8 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:26.721410 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-577f3f2d-2360-4fa4-a60f-959cb1f5dbe8 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:26.721864 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-577f3f2d-2360-4fa4-a60f-959cb1f5dbe8 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:26.722331 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.objects.instance [None req-577f3f2d-2360-4fa4-a60f-959cb1f5dbe8 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lazy-loading 'fault' on Instance uuid a8e59cc2-032c-497f-867c-2d5663a4da21 {{(pid=117820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:29:26.765141 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-577f3f2d-2360-4fa4-a60f-959cb1f5dbe8 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190f6130be544a73bb619f7b49ab4e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c28b78169ac49a6854f195bea0dd9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:29:26.774115 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-577f3f2d-2360-4fa4-a60f-959cb1f5dbe8 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 200 len: 1348 microversion: 2.1 time: 0.108796 Jul 29 05:29:26.774948 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 502/1040] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:29:26 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 1348 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:29:27.015783 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-ace5d14b-feb4-4fb4-8d56-989b947770fe req-d16d9efa-e0ef-4b31-b64c-691f5f06de2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87eb34fa-b0bc-4ee0-aeea-70301f77125d", "tag": "f47132ea-cd5d-4836-887a-b486a4824db2"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:29:27.027961 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-ace5d14b-feb4-4fb4-8d56-989b947770fe req-d16d9efa-e0ef-4b31-b64c-691f5f06de2b service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:27.028415 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-ace5d14b-feb4-4fb4-8d56-989b947770fe req-d16d9efa-e0ef-4b31-b64c-691f5f06de2b service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:27.040398 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-ace5d14b-feb4-4fb4-8d56-989b947770fe req-d16d9efa-e0ef-4b31-b64c-691f5f06de2b service nova] Creating event network-changed:f47132ea-cd5d-4836-887a-b486a4824db2 for instance 87eb34fa-b0bc-4ee0-aeea-70301f77125d on hv-cinder-85127 Jul 29 05:29:27.045703 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-ace5d14b-feb4-4fb4-8d56-989b947770fe req-d16d9efa-e0ef-4b31-b64c-691f5f06de2b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033699 Jul 29 05:29:27.046321 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 539/1041] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:29:27.796983 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-6cc1dec6-251e-4458-84c6-09eede7ed335 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:27.798528 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-6cc1dec6-251e-4458-84c6-09eede7ed335 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] [instance: a8e59cc2-032c-497f-867c-2d5663a4da21] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:29:27.809188 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6cc1dec6-251e-4458-84c6-09eede7ed335 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:27.810048 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6cc1dec6-251e-4458-84c6-09eede7ed335 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:27.811276 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6cc1dec6-251e-4458-84c6-09eede7ed335 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:29:27.812175 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6cc1dec6-251e-4458-84c6-09eede7ed335 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:29:27.829837 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.wsgi [None req-6cc1dec6-251e-4458-84c6-09eede7ed335 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] HTTP exception thrown: Instance a8e59cc2-032c-497f-867c-2d5663a4da21 could not be found. Jul 29 05:29:27.832328 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-6cc1dec6-251e-4458-84c6-09eede7ed335 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Request method failure captured: Jul 29 05:29:27.832328 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: request: GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 HTTP/1.1 Jul 29 05:29:27.832328 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept: application/json Jul 29 05:29:27.832328 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept-Encoding: identity Jul 29 05:29:27.832328 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Connection: close Jul 29 05:29:27.832328 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Length: 0 Jul 29 05:29:27.832328 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Type: application/json Jul 29 05:29:27.832328 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Host: 10.222.0.49 Jul 29 05:29:27.832328 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Openstack-System-Scope: None Jul 29 05:29:27.832328 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: User-Agent: python-urllib3/1.26.10 Jul 29 05:29:27.832328 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Auth-Token: gAAAAABi42-BfLvAq_u_fYBpdaue-gHbkekMVVSVSj-XQ-pq4O9HDjfpyM-N8ziHsidurodQrRBW-8e5W5oSsgal-yms4veuKHqDxT6yxo4PqrVYnP6pDcHncnJwBjnUT9OelMCqf3ezNa0_lyN0f2uoh9HX1Jg3cUm-7Py48NA2UUr2DXmSKkE Jul 29 05:29:27.832328 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Id: None Jul 29 05:29:27.832328 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Name: None Jul 29 05:29:27.832328 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Identity-Status: Confirmed Jul 29 05:29:27.832328 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Is-Admin-Project: True Jul 29 05:29:27.832328 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Id: default Jul 29 05:29:27.832328 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Name: Default Jul 29 05:29:27.832328 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Id: 4c28b78169ac49a6854f195bea0dd9bf Jul 29 05:29:27.832328 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Name: tempest-TestMinimumBasicScenario-125101285 Jul 29 05:29:27.832328 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Role: member,reader Jul 29 05:29:27.832328 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Roles: member,reader Jul 29 05:29:27.833949 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4c28b78169ac49a6854f195bea0dd9bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4c28b78169ac49a6854f195bea0dd9bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4c28b78169ac49a6854f195bea0dd9bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4c28b78169ac49a6854f195bea0dd9bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:29:27.833949 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant: tempest-TestMinimumBasicScenario-125101285 Jul 29 05:29:27.833949 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Id: 4c28b78169ac49a6854f195bea0dd9bf Jul 29 05:29:27.833949 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Name: tempest-TestMinimumBasicScenario-125101285 Jul 29 05:29:27.833949 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User: tempest-TestMinimumBasicScenario-125101285-project Jul 29 05:29:27.833949 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Id: default Jul 29 05:29:27.833949 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Name: Default Jul 29 05:29:27.833949 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Id: 190f6130be544a73bb619f7b49ab4e87 Jul 29 05:29:27.833949 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Name: tempest-TestMinimumBasicScenario-125101285-project Jul 29 05:29:27.833949 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: method: > Jul 29 05:29:27.833949 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: exception: Instance a8e59cc2-032c-497f-867c-2d5663a4da21 could not be found. Jul 29 05:29:27.833949 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: action_args: {'id': 'a8e59cc2-032c-497f-867c-2d5663a4da21'} Jul 29 05:29:27.834739 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:29:27.834739 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:29:27.834739 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:29:27.834739 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:29:27.834739 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:29:27.834739 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:29:27.834739 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:29:27.834739 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:29:27.834739 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:29:27.834739 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:29:27.834739 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8e59cc2-032c-497f-867c-2d5663a4da21 could not be found. Jul 29 05:29:27.834739 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:29:27.834739 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:29:27.834739 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:29:27.834739 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:29:27.834739 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:29:27.834739 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:29:27.834739 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:29:27.834739 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:29:27.834739 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:29:27.836249 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:29:27.836249 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:29:27.836249 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:29:27.836249 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:29:27.836249 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:29:27.836249 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:29:27.836249 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:29:27.836249 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8e59cc2-032c-497f-867c-2d5663a4da21 could not be found. Jul 29 05:29:27.836249 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:29:27.836249 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:29:27.836249 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:29:27.836249 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:29:27.836249 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:29:27.836249 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:29:27.836249 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:29:27.836249 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:29:27.836249 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8e59cc2-032c-497f-867c-2d5663a4da21 could not be found. Jul 29 05:29:27.836249 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:29:27.837671 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-6cc1dec6-251e-4458-84c6-09eede7ed335 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Returning 404 to user: Instance a8e59cc2-032c-497f-867c-2d5663a4da21 could not be found. {{(pid=117820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:29:27.837671 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-6cc1dec6-251e-4458-84c6-09eede7ed335 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21" status: 404 len: 111 microversion: 2.1 time: 0.041366 Jul 29 05:29:27.840041 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 503/1042] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:29:27 2022] GET /compute/v2.1/servers/a8e59cc2-032c-497f-867c-2d5663a4da21 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 05:29:27.850671 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-035f95a4-fe2b-4f7b-800b-98fef12f1939 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] Calling method '.version_select at 0x7fa6414bde50>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:29:27.886759 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-035f95a4-fe2b-4f7b-800b-98fef12f1939 tempest-TestMinimumBasicScenario-125101285 tempest-TestMinimumBasicScenario-125101285-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1818279114" status: 202 len: 0 microversion: 2.1 time: 0.044934 Jul 29 05:29:27.887880 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 540/1043] 10.222.0.49 () {58 vars in 1272 bytes} [Fri Jul 29 05:29:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1818279114 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 05:29:44.528168 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 05:29:44.528168 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Fri Jul 29 05:29:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 05:30:28.384830 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:30:28.389308 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell1:SELECT=22 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:30:28.644131 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-b3618d91-0195-4ebb-9b2a-517a6084d924 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Action: 'create', calling method: .version_select at 0x7fa63ac20670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1886222899", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4jtQaLERHDCZhTXyOSbeQvvais7q573e+OeWqTHbXDPgsKYJi2g6q+BlFWnKCTu52O4/lz0Qac1UqBb32Y8l2ZVmhYL3pj77Cx/9EEGEOptTXenxr/kp14aPfYRuuTYQ=="}} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:30:28.662865 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.quota [None req-b3618d91-0195-4ebb-9b2a-517a6084d924 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Getting quotas for project 3d61aa3cfb59443d849c3d09d839cff5. Resources: {'key_pairs'} {{(pid=117820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:30:28.668019 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.quota [None req-b3618d91-0195-4ebb-9b2a-517a6084d924 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Getting quotas for user 984ce8ca6aac41eab2c998c17d3820c5 and project 3d61aa3cfb59443d849c3d09d839cff5. Resources: {'key_pairs'} {{(pid=117820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:30:28.697248 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-b3618d91-0195-4ebb-9b2a-517a6084d924 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.315904 Jul 29 05:30:28.698997 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 504/1044] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Jul 29 05:30:28 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:30:44.425002 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell1:SELECT=82 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:30:44.425753 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:30:44.430056 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-7adfacb1-24e4-4528-af8a-7f1ba8222bd6 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-845687700", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1886222899", "security_groups": [{"name": "tempest-secgroup-smoke-139381983"}], "block_device_mapping_v2": [{"uuid": "b26db0f1-c6d2-440b-ac00-4ccb4372aa26", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1302f1f0-a05a-4d9f-86ca-6c2a0d9b3a4b"}]}} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:30:44.572112 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.network.neutron [None req-7adfacb1-24e4-4528-af8a-7f1ba8222bd6 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] validate_networks() for [('1302f1f0-a05a-4d9f-86ca-6c2a0d9b3a4b', None, None, None, None, None)] {{(pid=117821) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 05:30:44.977406 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-7adfacb1-24e4-4528-af8a-7f1ba8222bd6 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Flavor limits 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 05:30:44.977829 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-7adfacb1-24e4-4528-af8a-7f1ba8222bd6 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Image limits 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 05:30:44.978309 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-7adfacb1-24e4-4528-af8a-7f1ba8222bd6 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Flavor pref 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 05:30:44.978718 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-7adfacb1-24e4-4528-af8a-7f1ba8222bd6 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Image pref 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 05:30:44.979156 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-7adfacb1-24e4-4528-af8a-7f1ba8222bd6 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 05:30:44.988529 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7adfacb1-24e4-4528-af8a-7f1ba8222bd6 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:30:44.990167 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7adfacb1-24e4-4528-af8a-7f1ba8222bd6 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:30:44.990167 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7adfacb1-24e4-4528-af8a-7f1ba8222bd6 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:30:44.990167 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7adfacb1-24e4-4528-af8a-7f1ba8222bd6 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:30:45.008597 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.quota [None req-7adfacb1-24e4-4528-af8a-7f1ba8222bd6 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Getting quotas for project 3d61aa3cfb59443d849c3d09d839cff5. Resources: {'instances', 'ram', 'cores'} {{(pid=117821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:30:45.013759 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.quota [None req-7adfacb1-24e4-4528-af8a-7f1ba8222bd6 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Getting quotas for user 984ce8ca6aac41eab2c998c17d3820c5 and project 3d61aa3cfb59443d849c3d09d839cff5. Resources: {'instances', 'ram', 'cores'} {{(pid=117821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:30:45.077036 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-7adfacb1-24e4-4528-af8a-7f1ba8222bd6 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Going to run 1 instances... {{(pid=117821) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 05:30:45.079260 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-7adfacb1-24e4-4528-af8a-7f1ba8222bd6 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: cf290482-2215-4471-b672-b5f997b34352] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b26db0f1-c6d2-440b-ac00-4ccb4372aa26',volume_size=None,volume_type=None)] {{(pid=117821) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 05:30:45.237112 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-7adfacb1-24e4-4528-af8a-7f1ba8222bd6 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.813907 Jul 29 05:30:45.237684 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 541/1045] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 05:30:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 05:30:45.246807 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell0:SELECT=4 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:30:45.248017 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:30:45.252637 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-20b62fe0-3219-4926-8bb3-d5db0a25ccb7 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:30:45.253256 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-20b62fe0-3219-4926-8bb3-d5db0a25ccb7 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: cf290482-2215-4471-b672-b5f997b34352] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:30:45.320918 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-20b62fe0-3219-4926-8bb3-d5db0a25ccb7 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:30:45.328586 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-20b62fe0-3219-4926-8bb3-d5db0a25ccb7 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352" status: 200 len: 1094 microversion: 2.1 time: 0.083839 Jul 29 05:30:45.329164 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 505/1046] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:30:45 2022] GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352 => generated 1094 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:30:46.350793 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-41bd8331-d4ce-47e1-9ae5-87f07e7466f3 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:30:46.351438 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-41bd8331-d4ce-47e1-9ae5-87f07e7466f3 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: cf290482-2215-4471-b672-b5f997b34352] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:30:46.360345 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-41bd8331-d4ce-47e1-9ae5-87f07e7466f3 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:30:46.360815 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-41bd8331-d4ce-47e1-9ae5-87f07e7466f3 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:30:46.361691 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-41bd8331-d4ce-47e1-9ae5-87f07e7466f3 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:30:46.362244 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-41bd8331-d4ce-47e1-9ae5-87f07e7466f3 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:30:46.460118 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-41bd8331-d4ce-47e1-9ae5-87f07e7466f3 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:30:46.469932 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-41bd8331-d4ce-47e1-9ae5-87f07e7466f3 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352" status: 200 len: 1210 microversion: 2.1 time: 0.123015 Jul 29 05:30:46.485607 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 542/1047] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:30:46 2022] GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352 => generated 1210 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:30:47.497283 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-3bbe9bd8-88c5-4f93-8c25-17088b2a9f92 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:30:47.498501 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-3bbe9bd8-88c5-4f93-8c25-17088b2a9f92 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: cf290482-2215-4471-b672-b5f997b34352] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:30:47.504825 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3bbe9bd8-88c5-4f93-8c25-17088b2a9f92 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:30:47.505282 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3bbe9bd8-88c5-4f93-8c25-17088b2a9f92 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:30:47.506111 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3bbe9bd8-88c5-4f93-8c25-17088b2a9f92 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:30:47.506555 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3bbe9bd8-88c5-4f93-8c25-17088b2a9f92 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:30:47.736321 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-3bbe9bd8-88c5-4f93-8c25-17088b2a9f92 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:30:47.745097 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-3bbe9bd8-88c5-4f93-8c25-17088b2a9f92 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352" status: 200 len: 1265 microversion: 2.1 time: 0.251701 Jul 29 05:30:47.760541 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 506/1048] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:30:47 2022] GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352 => generated 1265 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:30:47.904971 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-4b483f93-19d7-41b5-bf4e-2a230ab3d2d9 req-bf4a49e3-9eb3-41ef-9664-f05960fb9a36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf290482-2215-4471-b672-b5f997b34352", "tag": "150ab5d2-1e6b-452c-adfc-4dbbe9f71343"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:30:47.919468 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-4b483f93-19d7-41b5-bf4e-2a230ab3d2d9 req-bf4a49e3-9eb3-41ef-9664-f05960fb9a36 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:30:47.920118 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-4b483f93-19d7-41b5-bf4e-2a230ab3d2d9 req-bf4a49e3-9eb3-41ef-9664-f05960fb9a36 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:30:47.932851 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-4b483f93-19d7-41b5-bf4e-2a230ab3d2d9 req-bf4a49e3-9eb3-41ef-9664-f05960fb9a36 service nova] Creating event network-changed:150ab5d2-1e6b-452c-adfc-4dbbe9f71343 for instance cf290482-2215-4471-b672-b5f997b34352 on hv-cinder-85127 Jul 29 05:30:47.942845 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-4b483f93-19d7-41b5-bf4e-2a230ab3d2d9 req-bf4a49e3-9eb3-41ef-9664-f05960fb9a36 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047745 Jul 29 05:30:47.944297 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 543/1049] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:30:48.768194 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-8b31822a-c1b5-4020-bf70-01256d19ae57 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:30:48.768831 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-8b31822a-c1b5-4020-bf70-01256d19ae57 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: cf290482-2215-4471-b672-b5f997b34352] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:30:48.775817 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8b31822a-c1b5-4020-bf70-01256d19ae57 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:30:48.776265 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8b31822a-c1b5-4020-bf70-01256d19ae57 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:30:48.777030 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8b31822a-c1b5-4020-bf70-01256d19ae57 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:30:48.777549 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8b31822a-c1b5-4020-bf70-01256d19ae57 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:30:49.006386 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-8b31822a-c1b5-4020-bf70-01256d19ae57 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:30:49.015539 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-8b31822a-c1b5-4020-bf70-01256d19ae57 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352" status: 200 len: 1265 microversion: 2.1 time: 0.251150 Jul 29 05:30:49.016135 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 507/1050] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:30:48 2022] GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352 => generated 1265 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:30:50.037954 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-6e04c75d-22f0-4260-a174-b569c963ec12 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:30:50.038658 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-6e04c75d-22f0-4260-a174-b569c963ec12 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: cf290482-2215-4471-b672-b5f997b34352] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:30:50.045757 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6e04c75d-22f0-4260-a174-b569c963ec12 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:30:50.046326 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6e04c75d-22f0-4260-a174-b569c963ec12 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:30:50.047258 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6e04c75d-22f0-4260-a174-b569c963ec12 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:30:50.047823 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6e04c75d-22f0-4260-a174-b569c963ec12 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:30:50.183626 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-6e04c75d-22f0-4260-a174-b569c963ec12 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:30:50.191755 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-6e04c75d-22f0-4260-a174-b569c963ec12 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352" status: 200 len: 1265 microversion: 2.1 time: 0.158414 Jul 29 05:30:50.192320 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 544/1051] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:30:50 2022] GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:30:51.213059 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-21130e4d-0ade-4044-975c-d73ce9144fce tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:30:51.213689 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-21130e4d-0ade-4044-975c-d73ce9144fce tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: cf290482-2215-4471-b672-b5f997b34352] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:30:51.221004 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-21130e4d-0ade-4044-975c-d73ce9144fce tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:30:51.221462 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-21130e4d-0ade-4044-975c-d73ce9144fce tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:30:51.222269 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-21130e4d-0ade-4044-975c-d73ce9144fce tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:30:51.222711 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-21130e4d-0ade-4044-975c-d73ce9144fce tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:30:51.357977 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-21130e4d-0ade-4044-975c-d73ce9144fce tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:30:51.365443 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-21130e4d-0ade-4044-975c-d73ce9144fce tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352" status: 200 len: 1265 microversion: 2.1 time: 0.156338 Jul 29 05:30:51.366010 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 508/1052] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:30:51 2022] GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:30:52.386111 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-754988ad-4e6b-4e6c-be40-c2431a3866e6 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:30:52.386719 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-754988ad-4e6b-4e6c-be40-c2431a3866e6 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: cf290482-2215-4471-b672-b5f997b34352] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:30:52.393318 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-754988ad-4e6b-4e6c-be40-c2431a3866e6 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:30:52.393774 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-754988ad-4e6b-4e6c-be40-c2431a3866e6 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:30:52.394540 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-754988ad-4e6b-4e6c-be40-c2431a3866e6 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:30:52.394981 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-754988ad-4e6b-4e6c-be40-c2431a3866e6 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:30:52.530634 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-754988ad-4e6b-4e6c-be40-c2431a3866e6 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:30:52.538068 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-754988ad-4e6b-4e6c-be40-c2431a3866e6 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352" status: 200 len: 1265 microversion: 2.1 time: 0.155884 Jul 29 05:30:52.538625 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 545/1053] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:30:52 2022] GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:30:53.558346 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-ba04b30d-39f8-431a-8df2-7b6c6206365e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:30:53.559510 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-ba04b30d-39f8-431a-8df2-7b6c6206365e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: cf290482-2215-4471-b672-b5f997b34352] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:30:53.566096 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ba04b30d-39f8-431a-8df2-7b6c6206365e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:30:53.566552 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ba04b30d-39f8-431a-8df2-7b6c6206365e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:30:53.567453 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ba04b30d-39f8-431a-8df2-7b6c6206365e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:30:53.567901 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ba04b30d-39f8-431a-8df2-7b6c6206365e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:30:53.706139 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-ba04b30d-39f8-431a-8df2-7b6c6206365e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:30:53.713471 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-ba04b30d-39f8-431a-8df2-7b6c6206365e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352" status: 200 len: 1265 microversion: 2.1 time: 0.159287 Jul 29 05:30:53.714028 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 509/1054] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:30:53 2022] GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:30:54.735476 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-8b47d54e-278d-45c4-a0a5-7f339dff6796 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:30:54.736087 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-8b47d54e-278d-45c4-a0a5-7f339dff6796 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: cf290482-2215-4471-b672-b5f997b34352] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:30:54.742879 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8b47d54e-278d-45c4-a0a5-7f339dff6796 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:30:54.743380 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8b47d54e-278d-45c4-a0a5-7f339dff6796 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:30:54.744170 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8b47d54e-278d-45c4-a0a5-7f339dff6796 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:30:54.744601 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8b47d54e-278d-45c4-a0a5-7f339dff6796 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:30:54.876703 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-8b47d54e-278d-45c4-a0a5-7f339dff6796 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:30:54.884351 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-8b47d54e-278d-45c4-a0a5-7f339dff6796 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352" status: 200 len: 1265 microversion: 2.1 time: 0.153200 Jul 29 05:30:54.884917 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 546/1055] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:30:54 2022] GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:30:55.907236 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-b4221e12-2b6d-4ab3-ac03-ab4432992550 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:30:55.908125 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-b4221e12-2b6d-4ab3-ac03-ab4432992550 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: cf290482-2215-4471-b672-b5f997b34352] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:30:55.910931 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell0:SELECT=2 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:30:55.916813 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b4221e12-2b6d-4ab3-ac03-ab4432992550 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:30:55.917273 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b4221e12-2b6d-4ab3-ac03-ab4432992550 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:30:55.918055 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b4221e12-2b6d-4ab3-ac03-ab4432992550 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:30:55.918502 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b4221e12-2b6d-4ab3-ac03-ab4432992550 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:30:56.056595 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-b4221e12-2b6d-4ab3-ac03-ab4432992550 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:30:56.064579 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-b4221e12-2b6d-4ab3-ac03-ab4432992550 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352" status: 200 len: 1265 microversion: 2.1 time: 0.162526 Jul 29 05:30:56.065089 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 510/1056] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:30:55 2022] GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:30:57.085641 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-e27d0c46-f2e6-462b-9b73-3ce3772e179a tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:30:57.086216 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-e27d0c46-f2e6-462b-9b73-3ce3772e179a tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: cf290482-2215-4471-b672-b5f997b34352] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:30:57.088136 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell0:SELECT=2 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:30:57.088802 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell0:SELECT=6 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:30:57.095516 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e27d0c46-f2e6-462b-9b73-3ce3772e179a tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:30:57.095969 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e27d0c46-f2e6-462b-9b73-3ce3772e179a tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:30:57.096738 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e27d0c46-f2e6-462b-9b73-3ce3772e179a tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:30:57.097183 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e27d0c46-f2e6-462b-9b73-3ce3772e179a tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:30:57.232184 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-e27d0c46-f2e6-462b-9b73-3ce3772e179a tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:30:57.239616 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-e27d0c46-f2e6-462b-9b73-3ce3772e179a tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352" status: 200 len: 1265 microversion: 2.1 time: 0.157905 Jul 29 05:30:57.240184 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 547/1057] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:30:57 2022] GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:30:58.266150 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-5cf0f09d-daf0-4c11-a0de-500efa90d2da tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:30:58.266769 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-5cf0f09d-daf0-4c11-a0de-500efa90d2da tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: cf290482-2215-4471-b672-b5f997b34352] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:30:58.273690 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5cf0f09d-daf0-4c11-a0de-500efa90d2da tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:30:58.274217 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5cf0f09d-daf0-4c11-a0de-500efa90d2da tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:30:58.274922 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5cf0f09d-daf0-4c11-a0de-500efa90d2da tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:30:58.275585 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5cf0f09d-daf0-4c11-a0de-500efa90d2da tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:30:58.431845 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-5cf0f09d-daf0-4c11-a0de-500efa90d2da tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:30:58.444377 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-5cf0f09d-daf0-4c11-a0de-500efa90d2da tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352" status: 200 len: 1265 microversion: 2.1 time: 0.185744 Jul 29 05:30:58.444894 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 511/1058] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:30:58 2022] GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:30:59.466083 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-4c4ab37f-1a63-4b66-9f18-c44fe5bba61d tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:30:59.466957 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-4c4ab37f-1a63-4b66-9f18-c44fe5bba61d tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: cf290482-2215-4471-b672-b5f997b34352] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:30:59.473282 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4c4ab37f-1a63-4b66-9f18-c44fe5bba61d tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:30:59.473733 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4c4ab37f-1a63-4b66-9f18-c44fe5bba61d tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:30:59.474489 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4c4ab37f-1a63-4b66-9f18-c44fe5bba61d tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:30:59.474983 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4c4ab37f-1a63-4b66-9f18-c44fe5bba61d tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:30:59.613386 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-4c4ab37f-1a63-4b66-9f18-c44fe5bba61d tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:30:59.621036 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-4c4ab37f-1a63-4b66-9f18-c44fe5bba61d tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352" status: 200 len: 1265 microversion: 2.1 time: 0.158864 Jul 29 05:30:59.621618 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 548/1059] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:30:59 2022] GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:30:59.689575 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-140ae0dc-544b-4254-891b-4a11a553faea req-4ea3fbbe-97d3-4042-bbc8-e156b220c341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf290482-2215-4471-b672-b5f997b34352", "name": "network-vif-plugged", "status": "completed", "tag": "150ab5d2-1e6b-452c-adfc-4dbbe9f71343"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:30:59.700086 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-140ae0dc-544b-4254-891b-4a11a553faea req-4ea3fbbe-97d3-4042-bbc8-e156b220c341 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:30:59.700591 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-140ae0dc-544b-4254-891b-4a11a553faea req-4ea3fbbe-97d3-4042-bbc8-e156b220c341 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:30:59.711848 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-140ae0dc-544b-4254-891b-4a11a553faea req-4ea3fbbe-97d3-4042-bbc8-e156b220c341 service nova] Creating event network-vif-plugged:150ab5d2-1e6b-452c-adfc-4dbbe9f71343 for instance cf290482-2215-4471-b672-b5f997b34352 on hv-cinder-85127 Jul 29 05:30:59.718096 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-140ae0dc-544b-4254-891b-4a11a553faea req-4ea3fbbe-97d3-4042-bbc8-e156b220c341 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032820 Jul 29 05:30:59.718839 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 512/1060] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:31:00.642167 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-5ca63bb4-35aa-4e56-99c9-00efdeb77564 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:31:00.642782 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-5ca63bb4-35aa-4e56-99c9-00efdeb77564 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: cf290482-2215-4471-b672-b5f997b34352] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:31:00.649643 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5ca63bb4-35aa-4e56-99c9-00efdeb77564 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:00.650094 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5ca63bb4-35aa-4e56-99c9-00efdeb77564 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:00.650858 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5ca63bb4-35aa-4e56-99c9-00efdeb77564 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:00.651297 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-5ca63bb4-35aa-4e56-99c9-00efdeb77564 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:00.785610 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-5ca63bb4-35aa-4e56-99c9-00efdeb77564 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:31:00.793171 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-5ca63bb4-35aa-4e56-99c9-00efdeb77564 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352" status: 200 len: 1265 microversion: 2.1 time: 0.154953 Jul 29 05:31:00.793793 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 549/1061] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:31:00 2022] GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:31:01.815043 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-a64e3b1b-1cc1-461e-b5ba-d106ecd84c65 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:31:01.815850 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-a64e3b1b-1cc1-461e-b5ba-d106ecd84c65 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: cf290482-2215-4471-b672-b5f997b34352] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:31:01.823160 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a64e3b1b-1cc1-461e-b5ba-d106ecd84c65 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:01.823657 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a64e3b1b-1cc1-461e-b5ba-d106ecd84c65 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:01.824439 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a64e3b1b-1cc1-461e-b5ba-d106ecd84c65 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:01.824886 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a64e3b1b-1cc1-461e-b5ba-d106ecd84c65 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:01.966634 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-a64e3b1b-1cc1-461e-b5ba-d106ecd84c65 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:31:01.974243 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-a64e3b1b-1cc1-461e-b5ba-d106ecd84c65 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352" status: 200 len: 1452 microversion: 2.1 time: 0.163961 Jul 29 05:31:01.974811 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 513/1062] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:31:01 2022] GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:31:01.994477 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-44644a8e-2d12-4d89-9c62-39cb90068a8a tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:31:01.995208 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-44644a8e-2d12-4d89-9c62-39cb90068a8a tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: cf290482-2215-4471-b672-b5f997b34352] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:31:02.002446 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-44644a8e-2d12-4d89-9c62-39cb90068a8a tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:02.002898 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-44644a8e-2d12-4d89-9c62-39cb90068a8a tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:02.003694 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-44644a8e-2d12-4d89-9c62-39cb90068a8a tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:02.004139 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-44644a8e-2d12-4d89-9c62-39cb90068a8a tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:02.251463 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-44644a8e-2d12-4d89-9c62-39cb90068a8a tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:31:02.260062 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-44644a8e-2d12-4d89-9c62-39cb90068a8a tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352" status: 200 len: 1452 microversion: 2.1 time: 0.269137 Jul 29 05:31:02.260643 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 550/1063] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:31:01 2022] GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352 => generated 1452 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:31:04.179911 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-2a42e8b8-7760-4157-b987-945e4d953c19 req-42eb875c-f395-465d-868e-7b6276e270f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf290482-2215-4471-b672-b5f997b34352", "tag": "150ab5d2-1e6b-452c-adfc-4dbbe9f71343"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:31:04.191043 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-2a42e8b8-7760-4157-b987-945e4d953c19 req-42eb875c-f395-465d-868e-7b6276e270f9 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:04.191526 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-2a42e8b8-7760-4157-b987-945e4d953c19 req-42eb875c-f395-465d-868e-7b6276e270f9 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:04.204579 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-2a42e8b8-7760-4157-b987-945e4d953c19 req-42eb875c-f395-465d-868e-7b6276e270f9 service nova] Creating event network-changed:150ab5d2-1e6b-452c-adfc-4dbbe9f71343 for instance cf290482-2215-4471-b672-b5f997b34352 on hv-cinder-85127 Jul 29 05:31:04.210406 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-2a42e8b8-7760-4157-b987-945e4d953c19 req-42eb875c-f395-465d-868e-7b6276e270f9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033774 Jul 29 05:31:04.211006 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 514/1064] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:31:21.582908 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 05:31:21.583590 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Fri Jul 29 05:31:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 05:31:32.399844 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-502f4d8b-ffc4-4ba9-b77c-5235903f8a62 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:31:32.400451 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-502f4d8b-ffc4-4ba9-b77c-5235903f8a62 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:31:32.402623 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:31:32.403282 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell1:SELECT=52 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:31:32.410625 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-502f4d8b-ffc4-4ba9-b77c-5235903f8a62 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:32.411080 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-502f4d8b-ffc4-4ba9-b77c-5235903f8a62 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:32.411893 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-502f4d8b-ffc4-4ba9-b77c-5235903f8a62 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:32.412329 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-502f4d8b-ffc4-4ba9-b77c-5235903f8a62 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:32.437012 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.objects.instance [None req-502f4d8b-ffc4-4ba9-b77c-5235903f8a62 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lazy-loading 'flavor' on Instance uuid 87eb34fa-b0bc-4ee0-aeea-70301f77125d {{(pid=117821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:31:32.524756 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-502f4d8b-ffc4-4ba9-b77c-5235903f8a62 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "POST /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d/action" status: 202 len: 0 microversion: 2.1 time: 0.128848 Jul 29 05:31:32.525368 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 551/1065] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Jul 29 05:31:32 2022] POST /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 05:31:32.534810 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-ad135531-670d-4cd1-9b55-512f8c07aa54 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:31:32.535665 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-ad135531-670d-4cd1-9b55-512f8c07aa54 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:31:32.538077 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_api:SELECT=22 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:31:32.538748 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell1:SELECT=46 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:31:32.545011 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ad135531-670d-4cd1-9b55-512f8c07aa54 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:32.545466 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ad135531-670d-4cd1-9b55-512f8c07aa54 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:32.546307 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ad135531-670d-4cd1-9b55-512f8c07aa54 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:32.547026 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-ad135531-670d-4cd1-9b55-512f8c07aa54 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:32.775703 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-ad135531-670d-4cd1-9b55-512f8c07aa54 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:31:32.784337 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-ad135531-670d-4cd1-9b55-512f8c07aa54 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1570 microversion: 2.1 time: 0.253733 Jul 29 05:31:32.785281 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 515/1066] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:31:32 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1570 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:31:33.807579 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-d8e0987b-5443-42f2-b164-2d6551657a68 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:31:33.808273 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-d8e0987b-5443-42f2-b164-2d6551657a68 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:31:33.814514 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d8e0987b-5443-42f2-b164-2d6551657a68 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:33.814964 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d8e0987b-5443-42f2-b164-2d6551657a68 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:33.816768 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d8e0987b-5443-42f2-b164-2d6551657a68 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:33.817215 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d8e0987b-5443-42f2-b164-2d6551657a68 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:33.952954 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-d8e0987b-5443-42f2-b164-2d6551657a68 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:31:33.961676 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-d8e0987b-5443-42f2-b164-2d6551657a68 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1570 microversion: 2.1 time: 0.158832 Jul 29 05:31:33.962247 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 552/1067] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:31:33 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:31:34.982643 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-28bcd032-caa6-4e56-af0e-bd0e0170f77f tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:31:34.983246 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-28bcd032-caa6-4e56-af0e-bd0e0170f77f tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:31:34.990420 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-28bcd032-caa6-4e56-af0e-bd0e0170f77f tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:34.990874 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-28bcd032-caa6-4e56-af0e-bd0e0170f77f tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:34.991665 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-28bcd032-caa6-4e56-af0e-bd0e0170f77f tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:34.992108 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-28bcd032-caa6-4e56-af0e-bd0e0170f77f tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:35.128797 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-28bcd032-caa6-4e56-af0e-bd0e0170f77f tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:31:35.136323 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-28bcd032-caa6-4e56-af0e-bd0e0170f77f tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1570 microversion: 2.1 time: 0.157577 Jul 29 05:31:35.136891 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 516/1068] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:31:34 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:31:36.158031 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-7345e3fa-c3a1-4431-b143-2bcdc60068d9 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:31:36.158625 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-7345e3fa-c3a1-4431-b143-2bcdc60068d9 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:31:36.165276 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7345e3fa-c3a1-4431-b143-2bcdc60068d9 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:36.165721 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7345e3fa-c3a1-4431-b143-2bcdc60068d9 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:36.166466 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7345e3fa-c3a1-4431-b143-2bcdc60068d9 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:36.166894 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7345e3fa-c3a1-4431-b143-2bcdc60068d9 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:36.302744 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-7345e3fa-c3a1-4431-b143-2bcdc60068d9 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:31:36.310492 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-7345e3fa-c3a1-4431-b143-2bcdc60068d9 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1570 microversion: 2.1 time: 0.156272 Jul 29 05:31:36.311065 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 553/1069] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:31:36 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:31:37.334642 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-665ac932-502f-4f29-a2e4-04be40d0cbdd tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:31:37.335360 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-665ac932-502f-4f29-a2e4-04be40d0cbdd tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:31:37.342729 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-665ac932-502f-4f29-a2e4-04be40d0cbdd tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:37.343196 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-665ac932-502f-4f29-a2e4-04be40d0cbdd tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:37.343999 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-665ac932-502f-4f29-a2e4-04be40d0cbdd tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:37.344441 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-665ac932-502f-4f29-a2e4-04be40d0cbdd tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:37.478461 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-665ac932-502f-4f29-a2e4-04be40d0cbdd tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:31:37.486001 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-665ac932-502f-4f29-a2e4-04be40d0cbdd tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1570 microversion: 2.1 time: 0.157042 Jul 29 05:31:37.486558 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 517/1070] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:31:37 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:31:38.508372 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-470e5b2d-d0d6-4e9e-bca6-fefa47ec7ccc tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:31:38.508978 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-470e5b2d-d0d6-4e9e-bca6-fefa47ec7ccc tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:31:38.515606 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-470e5b2d-d0d6-4e9e-bca6-fefa47ec7ccc tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:38.516062 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-470e5b2d-d0d6-4e9e-bca6-fefa47ec7ccc tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:38.516832 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-470e5b2d-d0d6-4e9e-bca6-fefa47ec7ccc tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:38.517301 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-470e5b2d-d0d6-4e9e-bca6-fefa47ec7ccc tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:38.652401 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-470e5b2d-d0d6-4e9e-bca6-fefa47ec7ccc tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:31:38.660041 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-470e5b2d-d0d6-4e9e-bca6-fefa47ec7ccc tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1570 microversion: 2.1 time: 0.156448 Jul 29 05:31:38.660689 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 554/1071] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:31:38 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:31:39.682330 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-d85fb74f-7471-4559-9fb0-c99fee53ac18 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:31:39.682928 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-d85fb74f-7471-4559-9fb0-c99fee53ac18 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:31:39.689509 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d85fb74f-7471-4559-9fb0-c99fee53ac18 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:39.689963 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d85fb74f-7471-4559-9fb0-c99fee53ac18 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:39.690734 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d85fb74f-7471-4559-9fb0-c99fee53ac18 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:39.691176 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d85fb74f-7471-4559-9fb0-c99fee53ac18 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:39.835413 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-d85fb74f-7471-4559-9fb0-c99fee53ac18 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:31:39.843007 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-d85fb74f-7471-4559-9fb0-c99fee53ac18 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1570 microversion: 2.1 time: 0.164550 Jul 29 05:31:39.843594 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 518/1072] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:31:39 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:31:40.865331 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-c042cb78-3dcb-4a60-802d-5c3c149ae55c tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:31:40.865959 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-c042cb78-3dcb-4a60-802d-5c3c149ae55c tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:31:40.872306 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c042cb78-3dcb-4a60-802d-5c3c149ae55c tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:40.872755 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c042cb78-3dcb-4a60-802d-5c3c149ae55c tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:40.873530 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c042cb78-3dcb-4a60-802d-5c3c149ae55c tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:40.873970 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c042cb78-3dcb-4a60-802d-5c3c149ae55c tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:41.014532 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-c042cb78-3dcb-4a60-802d-5c3c149ae55c tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:31:41.023306 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-c042cb78-3dcb-4a60-802d-5c3c149ae55c tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1570 microversion: 2.1 time: 0.162122 Jul 29 05:31:41.023933 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 555/1073] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:31:40 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:31:42.046160 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-0a398147-34e6-47ae-ae0a-efb3d06dc073 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:31:42.046784 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-0a398147-34e6-47ae-ae0a-efb3d06dc073 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:31:42.054071 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0a398147-34e6-47ae-ae0a-efb3d06dc073 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:42.054515 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0a398147-34e6-47ae-ae0a-efb3d06dc073 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:42.055275 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0a398147-34e6-47ae-ae0a-efb3d06dc073 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:42.055734 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0a398147-34e6-47ae-ae0a-efb3d06dc073 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:42.187608 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-0a398147-34e6-47ae-ae0a-efb3d06dc073 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:31:42.195563 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-0a398147-34e6-47ae-ae0a-efb3d06dc073 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1570 microversion: 2.1 time: 0.153851 Jul 29 05:31:42.196138 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 519/1074] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:31:42 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:31:43.217879 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-8105daea-fc04-4b50-bc71-c959d0be2e3a tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:31:43.218490 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-8105daea-fc04-4b50-bc71-c959d0be2e3a tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:31:43.225730 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8105daea-fc04-4b50-bc71-c959d0be2e3a tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:43.226185 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8105daea-fc04-4b50-bc71-c959d0be2e3a tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:43.226951 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8105daea-fc04-4b50-bc71-c959d0be2e3a tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:43.227415 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8105daea-fc04-4b50-bc71-c959d0be2e3a tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:43.368727 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-8105daea-fc04-4b50-bc71-c959d0be2e3a tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:31:43.376277 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-8105daea-fc04-4b50-bc71-c959d0be2e3a tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1570 microversion: 2.1 time: 0.162349 Jul 29 05:31:43.376841 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 556/1075] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:31:43 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:31:44.400062 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-c6fb490a-aea2-42ff-b9d7-308d893cdf43 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:31:44.400705 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-c6fb490a-aea2-42ff-b9d7-308d893cdf43 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:31:44.407293 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c6fb490a-aea2-42ff-b9d7-308d893cdf43 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:44.407779 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c6fb490a-aea2-42ff-b9d7-308d893cdf43 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:44.408547 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c6fb490a-aea2-42ff-b9d7-308d893cdf43 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:44.408992 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-c6fb490a-aea2-42ff-b9d7-308d893cdf43 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:44.548712 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-c6fb490a-aea2-42ff-b9d7-308d893cdf43 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:31:44.557438 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-c6fb490a-aea2-42ff-b9d7-308d893cdf43 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1570 microversion: 2.1 time: 0.162290 Jul 29 05:31:44.557998 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 520/1076] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:31:44 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:31:45.579622 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-1ec92ab0-d3c9-428d-9fac-4ee8afb809f6 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:31:45.580246 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-1ec92ab0-d3c9-428d-9fac-4ee8afb809f6 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:31:45.587735 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1ec92ab0-d3c9-428d-9fac-4ee8afb809f6 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:45.588311 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1ec92ab0-d3c9-428d-9fac-4ee8afb809f6 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:45.588949 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1ec92ab0-d3c9-428d-9fac-4ee8afb809f6 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:45.589387 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1ec92ab0-d3c9-428d-9fac-4ee8afb809f6 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:45.721988 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-1ec92ab0-d3c9-428d-9fac-4ee8afb809f6 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:31:45.729552 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-1ec92ab0-d3c9-428d-9fac-4ee8afb809f6 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1511 microversion: 2.1 time: 0.153913 Jul 29 05:31:45.730124 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 557/1077] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:31:45 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:31:45.750054 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-e7ba4b1a-b928-45de-aa7e-36645e2d1ee1 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:31:45.750647 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-e7ba4b1a-b928-45de-aa7e-36645e2d1ee1 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:31:45.757758 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e7ba4b1a-b928-45de-aa7e-36645e2d1ee1 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:45.758290 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e7ba4b1a-b928-45de-aa7e-36645e2d1ee1 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:45.759002 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e7ba4b1a-b928-45de-aa7e-36645e2d1ee1 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:45.759476 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e7ba4b1a-b928-45de-aa7e-36645e2d1ee1 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:45.788249 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-e7ba4b1a-b928-45de-aa7e-36645e2d1ee1 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117820) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 29 05:31:45.854401 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-e7ba4b1a-b928-45de-aa7e-36645e2d1ee1 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "POST /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d/action" status: 202 len: 0 microversion: 2.1 time: 0.108169 Jul 29 05:31:45.854919 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 521/1078] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Jul 29 05:31:45 2022] POST /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 05:31:45.863236 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-3280d006-93b8-481f-ad58-b5b79337fc18 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:31:45.863993 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-3280d006-93b8-481f-ad58-b5b79337fc18 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:31:45.870416 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3280d006-93b8-481f-ad58-b5b79337fc18 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:45.870876 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3280d006-93b8-481f-ad58-b5b79337fc18 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:45.871679 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3280d006-93b8-481f-ad58-b5b79337fc18 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:45.872124 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-3280d006-93b8-481f-ad58-b5b79337fc18 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:46.026455 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-3280d006-93b8-481f-ad58-b5b79337fc18 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:31:46.034304 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-3280d006-93b8-481f-ad58-b5b79337fc18 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1519 microversion: 2.1 time: 0.175123 Jul 29 05:31:46.034877 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 558/1079] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:31:45 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:31:47.056327 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-9fe5459e-08a9-467c-836e-3e9516ee6989 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:31:47.056867 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-9fe5459e-08a9-467c-836e-3e9516ee6989 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:31:47.063378 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9fe5459e-08a9-467c-836e-3e9516ee6989 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:47.063830 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9fe5459e-08a9-467c-836e-3e9516ee6989 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:47.064641 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9fe5459e-08a9-467c-836e-3e9516ee6989 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:47.065080 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9fe5459e-08a9-467c-836e-3e9516ee6989 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:47.204160 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-9fe5459e-08a9-467c-836e-3e9516ee6989 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:31:47.212765 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-9fe5459e-08a9-467c-836e-3e9516ee6989 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1521 microversion: 2.1 time: 0.160738 Jul 29 05:31:47.213413 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 522/1080] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:31:47 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:31:48.235482 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-d36ed5f6-503a-45ec-a23a-cc48d043d0d4 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:31:48.236093 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-d36ed5f6-503a-45ec-a23a-cc48d043d0d4 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:31:48.243394 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d36ed5f6-503a-45ec-a23a-cc48d043d0d4 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:48.243850 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d36ed5f6-503a-45ec-a23a-cc48d043d0d4 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:48.244620 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d36ed5f6-503a-45ec-a23a-cc48d043d0d4 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:48.245061 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d36ed5f6-503a-45ec-a23a-cc48d043d0d4 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:48.376190 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-d36ed5f6-503a-45ec-a23a-cc48d043d0d4 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:31:48.384534 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-d36ed5f6-503a-45ec-a23a-cc48d043d0d4 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1577 microversion: 2.1 time: 0.152995 Jul 29 05:31:48.385099 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 559/1081] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:31:48 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:31:49.406372 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-94a10be2-25a6-442a-8065-17c5abc5a2c6 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:31:49.406974 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-94a10be2-25a6-442a-8065-17c5abc5a2c6 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:31:49.413702 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-94a10be2-25a6-442a-8065-17c5abc5a2c6 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:49.414146 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-94a10be2-25a6-442a-8065-17c5abc5a2c6 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:49.414895 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-94a10be2-25a6-442a-8065-17c5abc5a2c6 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:49.415327 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-94a10be2-25a6-442a-8065-17c5abc5a2c6 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:49.554928 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-94a10be2-25a6-442a-8065-17c5abc5a2c6 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:31:49.562487 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-94a10be2-25a6-442a-8065-17c5abc5a2c6 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1577 microversion: 2.1 time: 0.160033 Jul 29 05:31:49.563045 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 523/1082] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:31:49 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:31:49.978494 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-d3ec948d-26ab-40fb-a0c4-92a021bbf3ca req-7752704f-2fcf-449c-9385-331d343a1f6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87eb34fa-b0bc-4ee0-aeea-70301f77125d", "name": "network-vif-unplugged", "status": "completed", "tag": "f47132ea-cd5d-4836-887a-b486a4824db2"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:31:49.990403 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-d3ec948d-26ab-40fb-a0c4-92a021bbf3ca req-7752704f-2fcf-449c-9385-331d343a1f6a service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:49.990872 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-d3ec948d-26ab-40fb-a0c4-92a021bbf3ca req-7752704f-2fcf-449c-9385-331d343a1f6a service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:50.002085 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-d3ec948d-26ab-40fb-a0c4-92a021bbf3ca req-7752704f-2fcf-449c-9385-331d343a1f6a service nova] Creating event network-vif-unplugged:f47132ea-cd5d-4836-887a-b486a4824db2 for instance 87eb34fa-b0bc-4ee0-aeea-70301f77125d on hv-cinder-85127 Jul 29 05:31:50.008398 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-d3ec948d-26ab-40fb-a0c4-92a021bbf3ca req-7752704f-2fcf-449c-9385-331d343a1f6a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033730 Jul 29 05:31:50.009124 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 560/1083] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:31:50.585836 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-7092ad55-5d63-490e-9086-38948c4bfc91 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:31:50.586397 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-7092ad55-5d63-490e-9086-38948c4bfc91 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:31:50.592859 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7092ad55-5d63-490e-9086-38948c4bfc91 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:50.593310 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7092ad55-5d63-490e-9086-38948c4bfc91 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:50.594074 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7092ad55-5d63-490e-9086-38948c4bfc91 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:50.594511 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-7092ad55-5d63-490e-9086-38948c4bfc91 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:50.726287 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-7092ad55-5d63-490e-9086-38948c4bfc91 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:31:50.733869 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-7092ad55-5d63-490e-9086-38948c4bfc91 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1577 microversion: 2.1 time: 0.152854 Jul 29 05:31:50.734439 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 524/1084] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:31:50 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:31:51.756495 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-549b3c1d-244f-4296-8666-155ae7054abb tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:31:51.757180 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-549b3c1d-244f-4296-8666-155ae7054abb tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:31:51.763426 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-549b3c1d-244f-4296-8666-155ae7054abb tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:51.763875 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-549b3c1d-244f-4296-8666-155ae7054abb tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:51.764688 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-549b3c1d-244f-4296-8666-155ae7054abb tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:51.765098 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-549b3c1d-244f-4296-8666-155ae7054abb tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:51.904680 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-549b3c1d-244f-4296-8666-155ae7054abb tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:31:51.912695 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-549b3c1d-244f-4296-8666-155ae7054abb tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1577 microversion: 2.1 time: 0.161402 Jul 29 05:31:51.913269 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 561/1085] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:31:51 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:31:52.935607 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-5b1d1814-bfea-42af-af19-c723f3002194 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:31:52.936199 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-5b1d1814-bfea-42af-af19-c723f3002194 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:31:52.942933 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5b1d1814-bfea-42af-af19-c723f3002194 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:52.943397 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5b1d1814-bfea-42af-af19-c723f3002194 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:52.944163 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5b1d1814-bfea-42af-af19-c723f3002194 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:52.944594 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5b1d1814-bfea-42af-af19-c723f3002194 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:53.097986 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-5b1d1814-bfea-42af-af19-c723f3002194 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:31:53.107307 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-5b1d1814-bfea-42af-af19-c723f3002194 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1577 microversion: 2.1 time: 0.176333 Jul 29 05:31:53.108007 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 525/1086] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:31:52 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1577 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:31:54.133081 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-d4780511-593c-4b45-bcb7-10079ea405e3 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:31:54.133693 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-d4780511-593c-4b45-bcb7-10079ea405e3 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:31:54.141308 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d4780511-593c-4b45-bcb7-10079ea405e3 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:54.141846 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d4780511-593c-4b45-bcb7-10079ea405e3 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:54.142607 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d4780511-593c-4b45-bcb7-10079ea405e3 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:54.143081 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-d4780511-593c-4b45-bcb7-10079ea405e3 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:54.290345 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-d4780511-593c-4b45-bcb7-10079ea405e3 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:31:54.298335 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-d4780511-593c-4b45-bcb7-10079ea405e3 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1577 microversion: 2.1 time: 0.169912 Jul 29 05:31:54.298925 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 562/1087] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:31:54 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:31:55.320476 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-f5aa00e8-465d-4df0-bde3-808774d86d95 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:31:55.321113 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-f5aa00e8-465d-4df0-bde3-808774d86d95 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:31:55.327709 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f5aa00e8-465d-4df0-bde3-808774d86d95 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:55.328165 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f5aa00e8-465d-4df0-bde3-808774d86d95 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:55.328921 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f5aa00e8-465d-4df0-bde3-808774d86d95 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:55.329397 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f5aa00e8-465d-4df0-bde3-808774d86d95 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:55.464512 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-f5aa00e8-465d-4df0-bde3-808774d86d95 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:31:55.473349 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-f5aa00e8-465d-4df0-bde3-808774d86d95 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1577 microversion: 2.1 time: 0.156709 Jul 29 05:31:55.474587 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 526/1088] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:31:55 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:31:56.496306 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-f52c43d9-2680-4ab5-b048-13e82003acbc tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:31:56.497021 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-f52c43d9-2680-4ab5-b048-13e82003acbc tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:31:56.503871 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f52c43d9-2680-4ab5-b048-13e82003acbc tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:56.504318 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f52c43d9-2680-4ab5-b048-13e82003acbc tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:56.505767 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f52c43d9-2680-4ab5-b048-13e82003acbc tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:56.506221 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-f52c43d9-2680-4ab5-b048-13e82003acbc tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:56.649271 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-f52c43d9-2680-4ab5-b048-13e82003acbc tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:31:56.657087 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-f52c43d9-2680-4ab5-b048-13e82003acbc tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1564 microversion: 2.1 time: 0.164807 Jul 29 05:31:56.657656 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 563/1089] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:31:56 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1564 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:31:58.073328 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-3fa1096e-8891-41a2-ad40-3e5b737ea3f4 req-70904553-205b-44a1-b772-bc7ad1c0a0c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87eb34fa-b0bc-4ee0-aeea-70301f77125d", "name": "network-vif-plugged", "status": "completed", "tag": "f47132ea-cd5d-4836-887a-b486a4824db2"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:31:58.085388 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-3fa1096e-8891-41a2-ad40-3e5b737ea3f4 req-70904553-205b-44a1-b772-bc7ad1c0a0c8 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:31:58.085850 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-3fa1096e-8891-41a2-ad40-3e5b737ea3f4 req-70904553-205b-44a1-b772-bc7ad1c0a0c8 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:31:58.099425 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-3fa1096e-8891-41a2-ad40-3e5b737ea3f4 req-70904553-205b-44a1-b772-bc7ad1c0a0c8 service nova] Creating event network-vif-plugged:f47132ea-cd5d-4836-887a-b486a4824db2 for instance 87eb34fa-b0bc-4ee0-aeea-70301f77125d on hv-cinder-85127 Jul 29 05:31:58.106139 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-3fa1096e-8891-41a2-ad40-3e5b737ea3f4 req-70904553-205b-44a1-b772-bc7ad1c0a0c8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035427 Jul 29 05:31:58.106772 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 527/1090] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:32:59.278691 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_api:SELECT=26 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:32:59.279566 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:32:59.284081 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-67014e25-d418-4c24-9832-f020f10a821a tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:32:59.284577 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-67014e25-d418-4c24-9832-f020f10a821a tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: cf290482-2215-4471-b672-b5f997b34352] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:32:59.292627 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-67014e25-d418-4c24-9832-f020f10a821a tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:32:59.293082 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-67014e25-d418-4c24-9832-f020f10a821a tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:32:59.293857 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-67014e25-d418-4c24-9832-f020f10a821a tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:32:59.294477 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-67014e25-d418-4c24-9832-f020f10a821a tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:32:59.322344 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-67014e25-d418-4c24-9832-f020f10a821a tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: cf290482-2215-4471-b672-b5f997b34352] Going to try to terminate instance {{(pid=117821) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 05:32:59.415241 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-67014e25-d418-4c24-9832-f020f10a821a tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "DELETE /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352" status: 204 len: 0 microversion: 2.1 time: 0.133538 Jul 29 05:32:59.415942 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 564/1091] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 05:32:59 2022] DELETE /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 29 05:32:59.423549 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:32:59.424371 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:32:59.429520 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-719f2f6a-b175-4720-bf21-6aabbeaa82cb tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:32:59.430225 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-719f2f6a-b175-4720-bf21-6aabbeaa82cb tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: cf290482-2215-4471-b672-b5f997b34352] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:32:59.439377 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-719f2f6a-b175-4720-bf21-6aabbeaa82cb tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:32:59.440138 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-719f2f6a-b175-4720-bf21-6aabbeaa82cb tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:32:59.440932 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-719f2f6a-b175-4720-bf21-6aabbeaa82cb tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:32:59.441380 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-719f2f6a-b175-4720-bf21-6aabbeaa82cb tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:32:59.595795 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-719f2f6a-b175-4720-bf21-6aabbeaa82cb tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:32:59.603439 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-719f2f6a-b175-4720-bf21-6aabbeaa82cb tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352" status: 200 len: 1577 microversion: 2.1 time: 0.182251 Jul 29 05:32:59.604012 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 528/1092] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:32:59 2022] GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352 => generated 1577 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:33:00.626854 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-1aba2972-d0eb-403b-8a16-181c5f586fc5 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:33:00.627539 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-1aba2972-d0eb-403b-8a16-181c5f586fc5 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: cf290482-2215-4471-b672-b5f997b34352] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:33:00.634048 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1aba2972-d0eb-403b-8a16-181c5f586fc5 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:00.634507 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1aba2972-d0eb-403b-8a16-181c5f586fc5 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:00.635273 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1aba2972-d0eb-403b-8a16-181c5f586fc5 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:00.635786 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-1aba2972-d0eb-403b-8a16-181c5f586fc5 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:00.770020 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-1aba2972-d0eb-403b-8a16-181c5f586fc5 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:33:00.777918 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-1aba2972-d0eb-403b-8a16-181c5f586fc5 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352" status: 200 len: 1577 microversion: 2.1 time: 0.155884 Jul 29 05:33:00.778484 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 565/1093] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:33:00 2022] GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:33:01.812202 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-6c9de158-5742-4afc-a5c9-f1b6cd030a29 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:33:01.812759 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-cace700c-9538-45fc-871c-a92dffc4f49a req-ead7e460-ecfb-47ac-91fe-3e4ccae93f07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf290482-2215-4471-b672-b5f997b34352", "name": "network-vif-deleted", "tag": "150ab5d2-1e6b-452c-adfc-4dbbe9f71343"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:33:01.814093 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-6c9de158-5742-4afc-a5c9-f1b6cd030a29 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: cf290482-2215-4471-b672-b5f997b34352] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:33:01.823499 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-cace700c-9538-45fc-871c-a92dffc4f49a req-ead7e460-ecfb-47ac-91fe-3e4ccae93f07 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:01.824107 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-cace700c-9538-45fc-871c-a92dffc4f49a req-ead7e460-ecfb-47ac-91fe-3e4ccae93f07 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:01.826171 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6c9de158-5742-4afc-a5c9-f1b6cd030a29 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:01.828208 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6c9de158-5742-4afc-a5c9-f1b6cd030a29 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:01.830165 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6c9de158-5742-4afc-a5c9-f1b6cd030a29 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:01.834594 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6c9de158-5742-4afc-a5c9-f1b6cd030a29 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:01.845995 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-cace700c-9538-45fc-871c-a92dffc4f49a req-ead7e460-ecfb-47ac-91fe-3e4ccae93f07 service nova] Creating event network-vif-deleted:150ab5d2-1e6b-452c-adfc-4dbbe9f71343 for instance cf290482-2215-4471-b672-b5f997b34352 on hv-cinder-85127 Jul 29 05:33:01.850958 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-cace700c-9538-45fc-871c-a92dffc4f49a req-ead7e460-ecfb-47ac-91fe-3e4ccae93f07 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100824 Jul 29 05:33:01.854641 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 529/1094] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:33:01.911945 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-6c9de158-5742-4afc-a5c9-f1b6cd030a29 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:33:01.919758 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-6c9de158-5742-4afc-a5c9-f1b6cd030a29 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352" status: 200 len: 1225 microversion: 2.1 time: 0.120932 Jul 29 05:33:01.920996 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 566/1095] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:33:01 2022] GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352 => generated 1225 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:33:02.942188 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-66481628-c6e6-4049-852b-972f2d3eb4ee tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:33:02.942885 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-66481628-c6e6-4049-852b-972f2d3eb4ee tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: cf290482-2215-4471-b672-b5f997b34352] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:33:02.949133 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-66481628-c6e6-4049-852b-972f2d3eb4ee tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:02.949590 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-66481628-c6e6-4049-852b-972f2d3eb4ee tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:02.950358 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-66481628-c6e6-4049-852b-972f2d3eb4ee tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:02.950802 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-66481628-c6e6-4049-852b-972f2d3eb4ee tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:02.964504 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.wsgi [None req-66481628-c6e6-4049-852b-972f2d3eb4ee tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] HTTP exception thrown: Instance cf290482-2215-4471-b672-b5f997b34352 could not be found. Jul 29 05:33:02.966115 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-66481628-c6e6-4049-852b-972f2d3eb4ee tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Request method failure captured: Jul 29 05:33:02.966115 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: request: GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352 HTTP/1.1 Jul 29 05:33:02.966115 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept: application/json Jul 29 05:33:02.966115 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept-Encoding: identity Jul 29 05:33:02.966115 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Connection: close Jul 29 05:33:02.966115 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Length: 0 Jul 29 05:33:02.966115 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Type: application/json Jul 29 05:33:02.966115 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Host: 10.222.0.49 Jul 29 05:33:02.966115 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Openstack-System-Scope: None Jul 29 05:33:02.966115 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: User-Agent: python-urllib3/1.26.10 Jul 29 05:33:02.966115 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Auth-Token: gAAAAABi43BuZp0AKwuW9Qu0O3_B2H56iyuAy9HSmssayuPJ5ki_Eb4B0AT314uMBZsesWB0kyeUx0qqsxoMEB3JnKsVatKWKwYLiESsrcCfJfFORtsxZbvlTbr7eqsZOBs3CRHj8v7WNaqjxt__Q_pgP9gFbBu4WOb6T8OAyFNc4t1SMfqZmcA Jul 29 05:33:02.966115 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Id: None Jul 29 05:33:02.966115 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Name: None Jul 29 05:33:02.966115 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Identity-Status: Confirmed Jul 29 05:33:02.966115 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Is-Admin-Project: True Jul 29 05:33:02.966115 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Id: default Jul 29 05:33:02.966115 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Name: Default Jul 29 05:33:02.966115 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Id: 3d61aa3cfb59443d849c3d09d839cff5 Jul 29 05:33:02.966115 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Name: tempest-TestVolumeBootPattern-421021144 Jul 29 05:33:02.966115 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Role: member,reader Jul 29 05:33:02.966115 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Roles: member,reader Jul 29 05:33:02.968445 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3d61aa3cfb59443d849c3d09d839cff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3d61aa3cfb59443d849c3d09d839cff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3d61aa3cfb59443d849c3d09d839cff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3d61aa3cfb59443d849c3d09d839cff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:33:02.968445 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant: tempest-TestVolumeBootPattern-421021144 Jul 29 05:33:02.968445 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Id: 3d61aa3cfb59443d849c3d09d839cff5 Jul 29 05:33:02.968445 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Name: tempest-TestVolumeBootPattern-421021144 Jul 29 05:33:02.968445 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User: tempest-TestVolumeBootPattern-421021144-project Jul 29 05:33:02.968445 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Id: default Jul 29 05:33:02.968445 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Name: Default Jul 29 05:33:02.968445 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Id: 984ce8ca6aac41eab2c998c17d3820c5 Jul 29 05:33:02.968445 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Name: tempest-TestVolumeBootPattern-421021144-project Jul 29 05:33:02.968445 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: method: > Jul 29 05:33:02.968445 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: exception: Instance cf290482-2215-4471-b672-b5f997b34352 could not be found. Jul 29 05:33:02.968445 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: action_args: {'id': 'cf290482-2215-4471-b672-b5f997b34352'} Jul 29 05:33:02.969463 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:33:02.969463 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:33:02.969463 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:33:02.969463 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:33:02.969463 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:33:02.969463 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:33:02.969463 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:33:02.969463 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:33:02.969463 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:33:02.969463 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:33:02.969463 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf290482-2215-4471-b672-b5f997b34352 could not be found. Jul 29 05:33:02.969463 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:33:02.969463 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:33:02.969463 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:33:02.969463 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:33:02.969463 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:33:02.969463 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:33:02.969463 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:33:02.969463 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:33:02.969463 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:33:02.971031 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:33:02.971031 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:33:02.971031 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:33:02.971031 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:33:02.971031 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:33:02.971031 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:33:02.971031 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:33:02.971031 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf290482-2215-4471-b672-b5f997b34352 could not be found. Jul 29 05:33:02.971031 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:33:02.971031 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:33:02.971031 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:33:02.971031 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:33:02.971031 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:33:02.971031 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:33:02.971031 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:33:02.971031 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:33:02.971031 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf290482-2215-4471-b672-b5f997b34352 could not be found. Jul 29 05:33:02.971031 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:33:02.972500 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-66481628-c6e6-4049-852b-972f2d3eb4ee tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Returning 404 to user: Instance cf290482-2215-4471-b672-b5f997b34352 could not be found. {{(pid=117820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:33:02.972500 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-66481628-c6e6-4049-852b-972f2d3eb4ee tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352" status: 404 len: 111 microversion: 2.1 time: 0.030950 Jul 29 05:33:02.972500 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 530/1096] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:33:02 2022] GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:33:03.018452 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-16891c34-603c-4041-9d42-fc0f3ef1f6f2 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1947594479", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1886222899", "security_groups": [{"name": "tempest-secgroup-smoke-139381983"}], "block_device_mapping_v2": [{"uuid": "b26db0f1-c6d2-440b-ac00-4ccb4372aa26", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1302f1f0-a05a-4d9f-86ca-6c2a0d9b3a4b"}]}} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:33:03.137167 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.network.neutron [None req-16891c34-603c-4041-9d42-fc0f3ef1f6f2 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] validate_networks() for [('1302f1f0-a05a-4d9f-86ca-6c2a0d9b3a4b', None, None, None, None, None)] {{(pid=117821) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 05:33:03.566517 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-16891c34-603c-4041-9d42-fc0f3ef1f6f2 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Flavor limits 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 05:33:03.566938 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-16891c34-603c-4041-9d42-fc0f3ef1f6f2 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Image limits 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 05:33:03.567434 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-16891c34-603c-4041-9d42-fc0f3ef1f6f2 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Flavor pref 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 05:33:03.567839 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-16891c34-603c-4041-9d42-fc0f3ef1f6f2 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Image pref 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 05:33:03.568243 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-16891c34-603c-4041-9d42-fc0f3ef1f6f2 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 05:33:03.577670 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-16891c34-603c-4041-9d42-fc0f3ef1f6f2 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:03.578110 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-16891c34-603c-4041-9d42-fc0f3ef1f6f2 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:03.578891 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-16891c34-603c-4041-9d42-fc0f3ef1f6f2 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:03.579373 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-16891c34-603c-4041-9d42-fc0f3ef1f6f2 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:03.595831 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.quota [None req-16891c34-603c-4041-9d42-fc0f3ef1f6f2 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Getting quotas for project 3d61aa3cfb59443d849c3d09d839cff5. Resources: {'instances', 'ram', 'cores'} {{(pid=117821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:33:03.599666 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.quota [None req-16891c34-603c-4041-9d42-fc0f3ef1f6f2 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Getting quotas for user 984ce8ca6aac41eab2c998c17d3820c5 and project 3d61aa3cfb59443d849c3d09d839cff5. Resources: {'instances', 'ram', 'cores'} {{(pid=117821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:33:03.658069 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-16891c34-603c-4041-9d42-fc0f3ef1f6f2 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Going to run 1 instances... {{(pid=117821) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 05:33:03.660294 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-16891c34-603c-4041-9d42-fc0f3ef1f6f2 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: ca4c859c-f307-446f-91a3-967c6ccf6afd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b26db0f1-c6d2-440b-ac00-4ccb4372aa26',volume_size=None,volume_type=None)] {{(pid=117821) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 05:33:03.790354 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-16891c34-603c-4041-9d42-fc0f3ef1f6f2 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.776876 Jul 29 05:33:03.791170 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 567/1097] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 05:33:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 05:33:03.802130 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-fb460eca-d74c-4650-84c0-528c2844a2ab tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:33:03.802744 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-fb460eca-d74c-4650-84c0-528c2844a2ab tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: ca4c859c-f307-446f-91a3-967c6ccf6afd] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:33:03.861454 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-fb460eca-d74c-4650-84c0-528c2844a2ab tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:33:03.868316 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-fb460eca-d74c-4650-84c0-528c2844a2ab tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd" status: 200 len: 1095 microversion: 2.1 time: 0.070026 Jul 29 05:33:03.868881 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 531/1098] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:33:03 2022] GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:33:04.889092 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-652c38f8-6cde-4727-8b80-7c371000f29f tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:33:04.889706 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-652c38f8-6cde-4727-8b80-7c371000f29f tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: ca4c859c-f307-446f-91a3-967c6ccf6afd] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:33:04.897025 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-652c38f8-6cde-4727-8b80-7c371000f29f tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:04.897475 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-652c38f8-6cde-4727-8b80-7c371000f29f tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:04.898236 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-652c38f8-6cde-4727-8b80-7c371000f29f tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:04.898670 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-652c38f8-6cde-4727-8b80-7c371000f29f tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:04.962585 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-652c38f8-6cde-4727-8b80-7c371000f29f tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:33:04.970962 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-652c38f8-6cde-4727-8b80-7c371000f29f tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd" status: 200 len: 1211 microversion: 2.1 time: 0.085152 Jul 29 05:33:04.971644 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 568/1099] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:33:04 2022] GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd => generated 1211 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:33:05.993693 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-f867817e-b635-469d-8f34-b240c7fdd69e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:33:05.994315 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-f867817e-b635-469d-8f34-b240c7fdd69e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: ca4c859c-f307-446f-91a3-967c6ccf6afd] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:33:06.002730 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f867817e-b635-469d-8f34-b240c7fdd69e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:06.003498 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f867817e-b635-469d-8f34-b240c7fdd69e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:06.004598 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f867817e-b635-469d-8f34-b240c7fdd69e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:06.005101 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-f867817e-b635-469d-8f34-b240c7fdd69e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:06.180872 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-0cf1a310-78c8-48ed-987e-00a226ca7416 req-32df4848-9530-4485-a4e0-4dcb19d1f035 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca4c859c-f307-446f-91a3-967c6ccf6afd", "tag": "99dc50ec-fe52-4053-870a-860015fe3269"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:33:06.193156 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-0cf1a310-78c8-48ed-987e-00a226ca7416 req-32df4848-9530-4485-a4e0-4dcb19d1f035 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:06.193789 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-0cf1a310-78c8-48ed-987e-00a226ca7416 req-32df4848-9530-4485-a4e0-4dcb19d1f035 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:06.215746 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-0cf1a310-78c8-48ed-987e-00a226ca7416 req-32df4848-9530-4485-a4e0-4dcb19d1f035 service nova] Creating event network-changed:99dc50ec-fe52-4053-870a-860015fe3269 for instance ca4c859c-f307-446f-91a3-967c6ccf6afd on hv-cinder-85127 Jul 29 05:33:06.222476 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-0cf1a310-78c8-48ed-987e-00a226ca7416 req-32df4848-9530-4485-a4e0-4dcb19d1f035 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046190 Jul 29 05:33:06.223318 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 569/1100] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:33:06.224814 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-f867817e-b635-469d-8f34-b240c7fdd69e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:33:06.232936 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-f867817e-b635-469d-8f34-b240c7fdd69e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd" status: 200 len: 1266 microversion: 2.1 time: 0.243544 Jul 29 05:33:06.233522 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 532/1101] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:33:05 2022] GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:33:07.255036 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-bc246170-962a-43d8-8e70-e06aa8eb4846 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:33:07.255790 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-bc246170-962a-43d8-8e70-e06aa8eb4846 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: ca4c859c-f307-446f-91a3-967c6ccf6afd] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:33:07.261983 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bc246170-962a-43d8-8e70-e06aa8eb4846 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:07.262429 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bc246170-962a-43d8-8e70-e06aa8eb4846 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:07.263191 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bc246170-962a-43d8-8e70-e06aa8eb4846 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:07.263653 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bc246170-962a-43d8-8e70-e06aa8eb4846 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:07.400497 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-bc246170-962a-43d8-8e70-e06aa8eb4846 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:33:07.409176 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-bc246170-962a-43d8-8e70-e06aa8eb4846 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd" status: 200 len: 1266 microversion: 2.1 time: 0.158819 Jul 29 05:33:07.409745 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 570/1102] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:33:07 2022] GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:33:07.636952 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 05:33:07.637370 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Fri Jul 29 05:33:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 05:33:08.430883 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-b3a17f16-efb1-46c8-a124-1ea96faedada tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:33:08.431443 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-b3a17f16-efb1-46c8-a124-1ea96faedada tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: ca4c859c-f307-446f-91a3-967c6ccf6afd] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:33:08.437964 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b3a17f16-efb1-46c8-a124-1ea96faedada tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:08.438423 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b3a17f16-efb1-46c8-a124-1ea96faedada tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:08.439940 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b3a17f16-efb1-46c8-a124-1ea96faedada tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:08.440387 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-b3a17f16-efb1-46c8-a124-1ea96faedada tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:08.573235 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-b3a17f16-efb1-46c8-a124-1ea96faedada tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:33:08.580776 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-b3a17f16-efb1-46c8-a124-1ea96faedada tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd" status: 200 len: 1266 microversion: 2.1 time: 0.153879 Jul 29 05:33:08.581343 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 533/1103] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:33:08 2022] GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:33:09.601863 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-36feabe9-f1f7-4279-b9be-b8948c92e7fa tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:33:09.602584 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-36feabe9-f1f7-4279-b9be-b8948c92e7fa tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: ca4c859c-f307-446f-91a3-967c6ccf6afd] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:33:09.608953 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-36feabe9-f1f7-4279-b9be-b8948c92e7fa tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:09.609488 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-36feabe9-f1f7-4279-b9be-b8948c92e7fa tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:09.610326 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-36feabe9-f1f7-4279-b9be-b8948c92e7fa tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:09.610838 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-36feabe9-f1f7-4279-b9be-b8948c92e7fa tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:09.785647 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-36feabe9-f1f7-4279-b9be-b8948c92e7fa tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:33:09.793110 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-36feabe9-f1f7-4279-b9be-b8948c92e7fa tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd" status: 200 len: 1266 microversion: 2.1 time: 0.195098 Jul 29 05:33:09.793672 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 571/1104] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:33:09 2022] GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:33:10.281578 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-824ecce2-d0a5-4789-a280-96fc5972090d tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:33:10.287778 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-824ecce2-d0a5-4789-a280-96fc5972090d tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:33:10.294752 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-824ecce2-d0a5-4789-a280-96fc5972090d tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:10.295455 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-824ecce2-d0a5-4789-a280-96fc5972090d tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:10.296232 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-824ecce2-d0a5-4789-a280-96fc5972090d tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:10.296865 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-824ecce2-d0a5-4789-a280-96fc5972090d tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:10.326221 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-824ecce2-d0a5-4789-a280-96fc5972090d tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Going to try to terminate instance {{(pid=117820) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 05:33:10.361863 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-890507a5-e6bb-42c4-87c0-13c93044a93c req-dc86e428-5279-440a-9f95-7baaa4b42088 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87eb34fa-b0bc-4ee0-aeea-70301f77125d", "tag": "f47132ea-cd5d-4836-887a-b486a4824db2"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:33:10.372820 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-890507a5-e6bb-42c4-87c0-13c93044a93c req-dc86e428-5279-440a-9f95-7baaa4b42088 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:10.373267 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-890507a5-e6bb-42c4-87c0-13c93044a93c req-dc86e428-5279-440a-9f95-7baaa4b42088 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:10.386167 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-890507a5-e6bb-42c4-87c0-13c93044a93c req-dc86e428-5279-440a-9f95-7baaa4b42088 service nova] Creating event network-changed:f47132ea-cd5d-4836-887a-b486a4824db2 for instance 87eb34fa-b0bc-4ee0-aeea-70301f77125d on hv-cinder-85127 Jul 29 05:33:10.391367 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-890507a5-e6bb-42c4-87c0-13c93044a93c req-dc86e428-5279-440a-9f95-7baaa4b42088 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108040 Jul 29 05:33:10.392088 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 572/1105] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:33:10.412662 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-824ecce2-d0a5-4789-a280-96fc5972090d tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "DELETE /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 204 len: 0 microversion: 2.1 time: 0.134859 Jul 29 05:33:10.413567 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 534/1106] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 05:33:10 2022] DELETE /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 05:33:10.422297 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-b67440ea-fd9b-426e-9db9-dbe0f1dfd24f tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:33:10.423006 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-b67440ea-fd9b-426e-9db9-dbe0f1dfd24f tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:33:10.430005 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b67440ea-fd9b-426e-9db9-dbe0f1dfd24f tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:10.430494 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b67440ea-fd9b-426e-9db9-dbe0f1dfd24f tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:10.431325 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b67440ea-fd9b-426e-9db9-dbe0f1dfd24f tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:10.431787 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-b67440ea-fd9b-426e-9db9-dbe0f1dfd24f tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:10.567869 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-b67440ea-fd9b-426e-9db9-dbe0f1dfd24f tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:33:10.584504 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-b67440ea-fd9b-426e-9db9-dbe0f1dfd24f tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1570 microversion: 2.1 time: 0.166359 Jul 29 05:33:10.585096 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 573/1107] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:33:10 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:33:10.814253 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-e0f0f56f-3116-4d92-b2c7-3bff96bfc2c1 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:33:10.816088 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-e0f0f56f-3116-4d92-b2c7-3bff96bfc2c1 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: ca4c859c-f307-446f-91a3-967c6ccf6afd] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:33:10.822122 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e0f0f56f-3116-4d92-b2c7-3bff96bfc2c1 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:10.822579 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e0f0f56f-3116-4d92-b2c7-3bff96bfc2c1 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:10.823366 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e0f0f56f-3116-4d92-b2c7-3bff96bfc2c1 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:10.823806 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e0f0f56f-3116-4d92-b2c7-3bff96bfc2c1 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:10.970007 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-e0f0f56f-3116-4d92-b2c7-3bff96bfc2c1 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:33:10.978216 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-e0f0f56f-3116-4d92-b2c7-3bff96bfc2c1 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd" status: 200 len: 1266 microversion: 2.1 time: 0.168126 Jul 29 05:33:10.978802 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 535/1108] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:33:10 2022] GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:33:11.607435 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-53ed30cf-00b6-4ed0-8662-1e670365e224 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:33:11.608058 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-53ed30cf-00b6-4ed0-8662-1e670365e224 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:33:11.615050 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-53ed30cf-00b6-4ed0-8662-1e670365e224 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:11.615529 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-53ed30cf-00b6-4ed0-8662-1e670365e224 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:11.616306 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-53ed30cf-00b6-4ed0-8662-1e670365e224 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:11.616734 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-53ed30cf-00b6-4ed0-8662-1e670365e224 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:11.756580 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-53ed30cf-00b6-4ed0-8662-1e670365e224 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:33:11.764914 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-53ed30cf-00b6-4ed0-8662-1e670365e224 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1570 microversion: 2.1 time: 0.161308 Jul 29 05:33:11.765483 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 574/1109] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:33:11 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:33:11.999375 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-9feec099-cbdd-4648-aff0-0966e81d72ca tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:33:12.000034 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-9feec099-cbdd-4648-aff0-0966e81d72ca tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: ca4c859c-f307-446f-91a3-967c6ccf6afd] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:33:12.006563 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9feec099-cbdd-4648-aff0-0966e81d72ca tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:12.006955 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9feec099-cbdd-4648-aff0-0966e81d72ca tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:12.007751 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9feec099-cbdd-4648-aff0-0966e81d72ca tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:12.008203 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-9feec099-cbdd-4648-aff0-0966e81d72ca tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:12.150794 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-9feec099-cbdd-4648-aff0-0966e81d72ca tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:33:12.158700 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-9feec099-cbdd-4648-aff0-0966e81d72ca tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd" status: 200 len: 1266 microversion: 2.1 time: 0.163156 Jul 29 05:33:12.159190 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 536/1110] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:33:11 2022] GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:33:12.787103 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-fedd4ea8-74fc-47c4-8dfe-77f71a4f4faa tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:33:12.787780 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-fedd4ea8-74fc-47c4-8dfe-77f71a4f4faa tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:33:12.794736 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-fedd4ea8-74fc-47c4-8dfe-77f71a4f4faa tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:12.795191 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-fedd4ea8-74fc-47c4-8dfe-77f71a4f4faa tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:12.796005 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-fedd4ea8-74fc-47c4-8dfe-77f71a4f4faa tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:12.796439 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-fedd4ea8-74fc-47c4-8dfe-77f71a4f4faa tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:12.938517 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-fedd4ea8-74fc-47c4-8dfe-77f71a4f4faa tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:33:12.946914 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-fedd4ea8-74fc-47c4-8dfe-77f71a4f4faa tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1570 microversion: 2.1 time: 0.164487 Jul 29 05:33:12.947540 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 575/1111] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:33:12 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:33:13.179657 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-19b8a167-8ff2-4b80-9cef-2e0b774d413e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:33:13.180296 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-19b8a167-8ff2-4b80-9cef-2e0b774d413e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: ca4c859c-f307-446f-91a3-967c6ccf6afd] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:33:13.186770 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-19b8a167-8ff2-4b80-9cef-2e0b774d413e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:13.187219 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-19b8a167-8ff2-4b80-9cef-2e0b774d413e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:13.188041 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-19b8a167-8ff2-4b80-9cef-2e0b774d413e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:13.188466 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-19b8a167-8ff2-4b80-9cef-2e0b774d413e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:13.404360 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-19b8a167-8ff2-4b80-9cef-2e0b774d413e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:33:13.413657 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-19b8a167-8ff2-4b80-9cef-2e0b774d413e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd" status: 200 len: 1266 microversion: 2.1 time: 0.237833 Jul 29 05:33:13.414260 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 537/1112] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:33:13 2022] GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:33:13.452055 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-fffd2069-0fb8-42de-b33e-fa4ce8ea3c2e req-3c1f9170-2fe4-40fe-88b6-cb23cd9e075e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87eb34fa-b0bc-4ee0-aeea-70301f77125d", "name": "network-vif-deleted", "tag": "f47132ea-cd5d-4836-887a-b486a4824db2"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:33:13.462415 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-fffd2069-0fb8-42de-b33e-fa4ce8ea3c2e req-3c1f9170-2fe4-40fe-88b6-cb23cd9e075e service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:13.462860 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-fffd2069-0fb8-42de-b33e-fa4ce8ea3c2e req-3c1f9170-2fe4-40fe-88b6-cb23cd9e075e service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:13.475397 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-fffd2069-0fb8-42de-b33e-fa4ce8ea3c2e req-3c1f9170-2fe4-40fe-88b6-cb23cd9e075e service nova] Creating event network-vif-deleted:f47132ea-cd5d-4836-887a-b486a4824db2 for instance 87eb34fa-b0bc-4ee0-aeea-70301f77125d on hv-cinder-85127 Jul 29 05:33:13.480487 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-fffd2069-0fb8-42de-b33e-fa4ce8ea3c2e req-3c1f9170-2fe4-40fe-88b6-cb23cd9e075e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032036 Jul 29 05:33:13.481083 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 576/1113] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:33:13.968357 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-42cbcde0-746d-4788-80d1-e9c0c5e4d32a tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:33:13.969107 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-42cbcde0-746d-4788-80d1-e9c0c5e4d32a tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:33:13.971097 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell0:SELECT=2 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:33:13.977626 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-42cbcde0-746d-4788-80d1-e9c0c5e4d32a tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:13.978084 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-42cbcde0-746d-4788-80d1-e9c0c5e4d32a tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:13.978868 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-42cbcde0-746d-4788-80d1-e9c0c5e4d32a tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:13.979482 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-42cbcde0-746d-4788-80d1-e9c0c5e4d32a tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:14.010760 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-42cbcde0-746d-4788-80d1-e9c0c5e4d32a tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:14.011212 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-42cbcde0-746d-4788-80d1-e9c0c5e4d32a tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:14.011710 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.objects.instance [None req-42cbcde0-746d-4788-80d1-e9c0c5e4d32a tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lazy-loading 'fault' on Instance uuid 87eb34fa-b0bc-4ee0-aeea-70301f77125d {{(pid=117820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:33:14.054631 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-42cbcde0-746d-4788-80d1-e9c0c5e4d32a tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1d0da1157a46c283bd442ad14d31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719297a86f0a4930b4daf3b9f663e472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:33:14.062319 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-42cbcde0-746d-4788-80d1-e9c0c5e4d32a tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 200 len: 1225 microversion: 2.1 time: 0.097917 Jul 29 05:33:14.062902 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 538/1114] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:33:13 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:33:14.431472 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell0:SELECT=2 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:33:14.432539 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell0:SELECT=6 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:33:14.437970 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-cdcc113b-c385-44d9-aab2-e0de2c266981 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:33:14.438679 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-cdcc113b-c385-44d9-aab2-e0de2c266981 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: ca4c859c-f307-446f-91a3-967c6ccf6afd] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:33:14.446579 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-cdcc113b-c385-44d9-aab2-e0de2c266981 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:14.447031 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-cdcc113b-c385-44d9-aab2-e0de2c266981 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:14.447848 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-cdcc113b-c385-44d9-aab2-e0de2c266981 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:14.448284 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-cdcc113b-c385-44d9-aab2-e0de2c266981 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:14.593743 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-cdcc113b-c385-44d9-aab2-e0de2c266981 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:33:14.602274 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-cdcc113b-c385-44d9-aab2-e0de2c266981 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd" status: 200 len: 1266 microversion: 2.1 time: 0.171667 Jul 29 05:33:14.602856 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 577/1115] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:33:14 2022] GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:33:15.085403 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-a9d37f88-3c2a-4651-8b43-4539aaf74971 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:33:15.086008 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-a9d37f88-3c2a-4651-8b43-4539aaf74971 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] [instance: 87eb34fa-b0bc-4ee0-aeea-70301f77125d] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:33:15.092711 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a9d37f88-3c2a-4651-8b43-4539aaf74971 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:15.093166 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a9d37f88-3c2a-4651-8b43-4539aaf74971 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:15.093941 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a9d37f88-3c2a-4651-8b43-4539aaf74971 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:15.094386 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-a9d37f88-3c2a-4651-8b43-4539aaf74971 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:15.108281 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.wsgi [None req-a9d37f88-3c2a-4651-8b43-4539aaf74971 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] HTTP exception thrown: Instance 87eb34fa-b0bc-4ee0-aeea-70301f77125d could not be found. Jul 29 05:33:15.109946 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-a9d37f88-3c2a-4651-8b43-4539aaf74971 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Request method failure captured: Jul 29 05:33:15.109946 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: request: GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d HTTP/1.1 Jul 29 05:33:15.109946 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept: application/json Jul 29 05:33:15.109946 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept-Encoding: identity Jul 29 05:33:15.109946 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Connection: close Jul 29 05:33:15.109946 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Length: 0 Jul 29 05:33:15.109946 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Type: application/json Jul 29 05:33:15.109946 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Host: 10.222.0.49 Jul 29 05:33:15.109946 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Openstack-System-Scope: None Jul 29 05:33:15.109946 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: User-Agent: python-urllib3/1.26.10 Jul 29 05:33:15.109946 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Auth-Token: gAAAAABi42_zBeefGkT3dczeyvDbAtmEeMU74XSy7gjLm_UX6nkEgXmDMcLplDCxteYbedmBPfjGAnX_qm5ApuuzXwhBMe8oA4YQ20Jg6toptSDRx7RAXeRDf8d7OoYhTsrp4RoXWxJyubVN-RdhwR-zV1QyUceNUPdTSl5TlEu02AekZFUVprc Jul 29 05:33:15.109946 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Id: None Jul 29 05:33:15.109946 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Name: None Jul 29 05:33:15.109946 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Identity-Status: Confirmed Jul 29 05:33:15.109946 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Is-Admin-Project: True Jul 29 05:33:15.109946 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Id: default Jul 29 05:33:15.109946 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Name: Default Jul 29 05:33:15.109946 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Id: 719297a86f0a4930b4daf3b9f663e472 Jul 29 05:33:15.109946 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Name: tempest-TestShelveInstance-1891525518 Jul 29 05:33:15.109946 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Role: member,reader Jul 29 05:33:15.109946 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Roles: member,reader Jul 29 05:33:15.111638 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/719297a86f0a4930b4daf3b9f663e472"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/719297a86f0a4930b4daf3b9f663e472"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_719297a86f0a4930b4daf3b9f663e472"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/719297a86f0a4930b4daf3b9f663e472"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:33:15.111638 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant: tempest-TestShelveInstance-1891525518 Jul 29 05:33:15.111638 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Id: 719297a86f0a4930b4daf3b9f663e472 Jul 29 05:33:15.111638 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Name: tempest-TestShelveInstance-1891525518 Jul 29 05:33:15.111638 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User: tempest-TestShelveInstance-1891525518-project Jul 29 05:33:15.111638 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Id: default Jul 29 05:33:15.111638 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Name: Default Jul 29 05:33:15.111638 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Id: 5b1d0da1157a46c283bd442ad14d31b5 Jul 29 05:33:15.111638 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Name: tempest-TestShelveInstance-1891525518-project Jul 29 05:33:15.111638 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: method: > Jul 29 05:33:15.111638 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: exception: Instance 87eb34fa-b0bc-4ee0-aeea-70301f77125d could not be found. Jul 29 05:33:15.111638 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: action_args: {'id': '87eb34fa-b0bc-4ee0-aeea-70301f77125d'} Jul 29 05:33:15.113276 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:33:15.113276 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:33:15.113276 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:33:15.113276 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:33:15.113276 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:33:15.113276 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:33:15.113276 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:33:15.113276 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:33:15.113276 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:33:15.113276 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:33:15.113276 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87eb34fa-b0bc-4ee0-aeea-70301f77125d could not be found. Jul 29 05:33:15.113276 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:33:15.113276 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:33:15.113276 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:33:15.113276 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:33:15.113276 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:33:15.113276 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:33:15.113276 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:33:15.113276 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:33:15.113276 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:33:15.114555 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:33:15.114555 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:33:15.114555 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:33:15.114555 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:33:15.114555 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:33:15.114555 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:33:15.114555 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:33:15.114555 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87eb34fa-b0bc-4ee0-aeea-70301f77125d could not be found. Jul 29 05:33:15.114555 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:33:15.114555 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:33:15.114555 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:33:15.114555 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:33:15.114555 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:33:15.114555 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:33:15.114555 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:33:15.114555 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:33:15.114555 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87eb34fa-b0bc-4ee0-aeea-70301f77125d could not be found. Jul 29 05:33:15.114555 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:33:15.115768 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-a9d37f88-3c2a-4651-8b43-4539aaf74971 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Returning 404 to user: Instance 87eb34fa-b0bc-4ee0-aeea-70301f77125d could not be found. {{(pid=117820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:33:15.115768 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-a9d37f88-3c2a-4651-8b43-4539aaf74971 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d" status: 404 len: 111 microversion: 2.1 time: 0.030995 Jul 29 05:33:15.115768 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 539/1116] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:33:15 2022] GET /compute/v2.1/servers/87eb34fa-b0bc-4ee0-aeea-70301f77125d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:33:15.325605 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-8fc12844-9bf8-45cf-b711-d37220db0a91 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] Calling method '.version_select at 0x7fa63abbdca0>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:33:15.350620 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-8fc12844-9bf8-45cf-b711-d37220db0a91 tempest-TestShelveInstance-1891525518 tempest-TestShelveInstance-1891525518-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1818523598" status: 202 len: 0 microversion: 2.1 time: 0.029008 Jul 29 05:33:15.355926 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 578/1117] 10.222.0.49 () {58 vars in 1254 bytes} [Fri Jul 29 05:33:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1818523598 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 05:33:15.625788 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-3b4306b4-1e46-4786-a710-461e8ff2446b tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:33:15.626570 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-3b4306b4-1e46-4786-a710-461e8ff2446b tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: ca4c859c-f307-446f-91a3-967c6ccf6afd] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:33:15.634650 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3b4306b4-1e46-4786-a710-461e8ff2446b tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:15.635147 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3b4306b4-1e46-4786-a710-461e8ff2446b tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:15.636086 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3b4306b4-1e46-4786-a710-461e8ff2446b tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:15.636713 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-3b4306b4-1e46-4786-a710-461e8ff2446b tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:15.846332 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-3b4306b4-1e46-4786-a710-461e8ff2446b tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:33:15.854311 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-3b4306b4-1e46-4786-a710-461e8ff2446b tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd" status: 200 len: 1266 microversion: 2.1 time: 0.232405 Jul 29 05:33:15.855109 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 540/1118] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:33:15 2022] GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:33:16.511031 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-5149e585-3f54-4199-ba9a-eeaa044eae3a req-68b6f9c9-c74c-4019-ba9e-6bf48b4ba996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca4c859c-f307-446f-91a3-967c6ccf6afd", "name": "network-vif-plugged", "status": "completed", "tag": "99dc50ec-fe52-4053-870a-860015fe3269"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:33:16.522498 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-5149e585-3f54-4199-ba9a-eeaa044eae3a req-68b6f9c9-c74c-4019-ba9e-6bf48b4ba996 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:16.523228 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-5149e585-3f54-4199-ba9a-eeaa044eae3a req-68b6f9c9-c74c-4019-ba9e-6bf48b4ba996 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:16.548872 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-5149e585-3f54-4199-ba9a-eeaa044eae3a req-68b6f9c9-c74c-4019-ba9e-6bf48b4ba996 service nova] Creating event network-vif-plugged:99dc50ec-fe52-4053-870a-860015fe3269 for instance ca4c859c-f307-446f-91a3-967c6ccf6afd on hv-cinder-85127 Jul 29 05:33:16.555858 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-5149e585-3f54-4199-ba9a-eeaa044eae3a req-68b6f9c9-c74c-4019-ba9e-6bf48b4ba996 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136385 Jul 29 05:33:16.559880 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 579/1119] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:33:16.875086 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-8c4524eb-a7b5-48af-ac11-0a294eade5c6 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:33:16.875827 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-8c4524eb-a7b5-48af-ac11-0a294eade5c6 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: ca4c859c-f307-446f-91a3-967c6ccf6afd] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:33:16.882982 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8c4524eb-a7b5-48af-ac11-0a294eade5c6 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:16.883469 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8c4524eb-a7b5-48af-ac11-0a294eade5c6 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:16.884249 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8c4524eb-a7b5-48af-ac11-0a294eade5c6 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:16.884687 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8c4524eb-a7b5-48af-ac11-0a294eade5c6 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:17.107621 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-8c4524eb-a7b5-48af-ac11-0a294eade5c6 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:33:17.115753 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-8c4524eb-a7b5-48af-ac11-0a294eade5c6 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd" status: 200 len: 1266 microversion: 2.1 time: 0.244643 Jul 29 05:33:17.116334 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 541/1120] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:33:16 2022] GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:33:18.138846 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-52925e83-6a34-4402-b60e-e77f3303759f tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:33:18.139636 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-52925e83-6a34-4402-b60e-e77f3303759f tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: ca4c859c-f307-446f-91a3-967c6ccf6afd] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:33:18.147595 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-52925e83-6a34-4402-b60e-e77f3303759f tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:18.148049 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-52925e83-6a34-4402-b60e-e77f3303759f tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:18.149029 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-52925e83-6a34-4402-b60e-e77f3303759f tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:18.149280 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-52925e83-6a34-4402-b60e-e77f3303759f tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:18.321257 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-52925e83-6a34-4402-b60e-e77f3303759f tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:33:18.329262 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-52925e83-6a34-4402-b60e-e77f3303759f tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd" status: 200 len: 1266 microversion: 2.1 time: 0.195537 Jul 29 05:33:18.329778 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 580/1121] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:33:18 2022] GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:33:19.352271 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-cc390e55-b9e7-413e-af30-53ae7e3fb514 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:33:19.352956 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-cc390e55-b9e7-413e-af30-53ae7e3fb514 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: ca4c859c-f307-446f-91a3-967c6ccf6afd] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:33:19.359267 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-cc390e55-b9e7-413e-af30-53ae7e3fb514 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:19.359751 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-cc390e55-b9e7-413e-af30-53ae7e3fb514 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:19.360611 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-cc390e55-b9e7-413e-af30-53ae7e3fb514 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:19.361126 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-cc390e55-b9e7-413e-af30-53ae7e3fb514 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:19.501818 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-cc390e55-b9e7-413e-af30-53ae7e3fb514 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:33:19.511073 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-cc390e55-b9e7-413e-af30-53ae7e3fb514 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd" status: 200 len: 1453 microversion: 2.1 time: 0.163524 Jul 29 05:33:19.511687 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 542/1122] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:33:19 2022] GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd => generated 1453 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:33:19.538218 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-4786a275-7f37-4e58-8aec-45892baecde1 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:33:19.545211 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-4786a275-7f37-4e58-8aec-45892baecde1 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: ca4c859c-f307-446f-91a3-967c6ccf6afd] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:33:19.553673 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4786a275-7f37-4e58-8aec-45892baecde1 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:19.554207 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4786a275-7f37-4e58-8aec-45892baecde1 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:19.555106 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4786a275-7f37-4e58-8aec-45892baecde1 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:19.555650 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-4786a275-7f37-4e58-8aec-45892baecde1 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:19.804117 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-4786a275-7f37-4e58-8aec-45892baecde1 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:33:19.813011 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-4786a275-7f37-4e58-8aec-45892baecde1 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd" status: 200 len: 1453 microversion: 2.1 time: 0.279847 Jul 29 05:33:19.813649 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 581/1123] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:33:19 2022] GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd => generated 1453 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:33:22.241456 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-a284cff7-3018-4ac2-9507-607f7ba9f13e req-02a1f169-f0e0-4079-81e3-6b0246f22af0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca4c859c-f307-446f-91a3-967c6ccf6afd", "tag": "99dc50ec-fe52-4053-870a-860015fe3269"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:33:22.256145 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-a284cff7-3018-4ac2-9507-607f7ba9f13e req-02a1f169-f0e0-4079-81e3-6b0246f22af0 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:33:22.256603 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-a284cff7-3018-4ac2-9507-607f7ba9f13e req-02a1f169-f0e0-4079-81e3-6b0246f22af0 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:33:22.274817 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-a284cff7-3018-4ac2-9507-607f7ba9f13e req-02a1f169-f0e0-4079-81e3-6b0246f22af0 service nova] Creating event network-changed:99dc50ec-fe52-4053-870a-860015fe3269 for instance ca4c859c-f307-446f-91a3-967c6ccf6afd on hv-cinder-85127 Jul 29 05:33:22.280980 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-a284cff7-3018-4ac2-9507-607f7ba9f13e req-02a1f169-f0e0-4079-81e3-6b0246f22af0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043982 Jul 29 05:33:22.281610 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 543/1124] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:34:41.591731 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 05:34:41.592420 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Fri Jul 29 05:34:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 05:34:56.359812 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:34:56.360596 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:34:56.365452 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-8e081192-0a3c-4a25-9b33-9f358d3240bc tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1145695435", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1886222899", "security_groups": [{"name": "tempest-secgroup-smoke-139381983"}], "block_device_mapping_v2": [{"uuid": "c4abe0f0-e48e-417e-9b59-68dd03b4cfb9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1302f1f0-a05a-4d9f-86ca-6c2a0d9b3a4b"}]}} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:34:56.480025 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.network.neutron [None req-8e081192-0a3c-4a25-9b33-9f358d3240bc tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] validate_networks() for [('1302f1f0-a05a-4d9f-86ca-6c2a0d9b3a4b', None, None, None, None, None)] {{(pid=117821) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 05:34:56.851726 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-8e081192-0a3c-4a25-9b33-9f358d3240bc tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Flavor limits 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 05:34:56.852149 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-8e081192-0a3c-4a25-9b33-9f358d3240bc tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Image limits 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 05:34:56.852652 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-8e081192-0a3c-4a25-9b33-9f358d3240bc tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Flavor pref 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 05:34:56.853060 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-8e081192-0a3c-4a25-9b33-9f358d3240bc tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Image pref 0:0:0 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 05:34:56.853478 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.virt.hardware [None req-8e081192-0a3c-4a25-9b33-9f358d3240bc tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 05:34:56.862362 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8e081192-0a3c-4a25-9b33-9f358d3240bc tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:34:56.862808 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8e081192-0a3c-4a25-9b33-9f358d3240bc tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:34:56.863650 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8e081192-0a3c-4a25-9b33-9f358d3240bc tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:34:56.864094 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-8e081192-0a3c-4a25-9b33-9f358d3240bc tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:34:56.882806 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.quota [None req-8e081192-0a3c-4a25-9b33-9f358d3240bc tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Getting quotas for project 3d61aa3cfb59443d849c3d09d839cff5. Resources: {'instances', 'ram', 'cores'} {{(pid=117821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:34:56.886765 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.quota [None req-8e081192-0a3c-4a25-9b33-9f358d3240bc tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Getting quotas for user 984ce8ca6aac41eab2c998c17d3820c5 and project 3d61aa3cfb59443d849c3d09d839cff5. Resources: {'instances', 'ram', 'cores'} {{(pid=117821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:34:56.960365 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-8e081192-0a3c-4a25-9b33-9f358d3240bc tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Going to run 1 instances... {{(pid=117821) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 05:34:56.962445 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-8e081192-0a3c-4a25-9b33-9f358d3240bc tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: 1a1829ec-d021-4713-83d5-cb35394204ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c4abe0f0-e48e-417e-9b59-68dd03b4cfb9',volume_size=None,volume_type=None)] {{(pid=117821) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 05:34:57.090698 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-8e081192-0a3c-4a25-9b33-9f358d3240bc tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.732826 Jul 29 05:34:57.091371 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 582/1125] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 05:34:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 05:34:57.101317 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:34:57.102081 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:34:57.106583 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-be4183f9-aae9-484d-b38e-8577bc1c7b3d tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:34:57.107285 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-be4183f9-aae9-484d-b38e-8577bc1c7b3d tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: 1a1829ec-d021-4713-83d5-cb35394204ac] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:34:57.175020 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-be4183f9-aae9-484d-b38e-8577bc1c7b3d tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:34:57.181822 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-be4183f9-aae9-484d-b38e-8577bc1c7b3d tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac" status: 200 len: 1095 microversion: 2.1 time: 0.083559 Jul 29 05:34:57.182379 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 544/1126] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:34:57 2022] GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac => generated 1095 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:34:58.202789 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-bdc867e9-7d11-4267-81b6-25ee5cd2abf4 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:34:58.203519 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-bdc867e9-7d11-4267-81b6-25ee5cd2abf4 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: 1a1829ec-d021-4713-83d5-cb35394204ac] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:34:58.211105 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bdc867e9-7d11-4267-81b6-25ee5cd2abf4 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:34:58.211564 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bdc867e9-7d11-4267-81b6-25ee5cd2abf4 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:34:58.212343 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bdc867e9-7d11-4267-81b6-25ee5cd2abf4 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:34:58.212780 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-bdc867e9-7d11-4267-81b6-25ee5cd2abf4 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:34:58.278347 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-bdc867e9-7d11-4267-81b6-25ee5cd2abf4 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:34:58.287598 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-bdc867e9-7d11-4267-81b6-25ee5cd2abf4 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac" status: 200 len: 1211 microversion: 2.1 time: 0.088614 Jul 29 05:34:58.288238 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 583/1127] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:34:58 2022] GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac => generated 1211 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:34:59.313618 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-91dd512b-7973-4c71-b707-17145b267996 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:34:59.314195 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-91dd512b-7973-4c71-b707-17145b267996 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: 1a1829ec-d021-4713-83d5-cb35394204ac] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:34:59.322896 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-91dd512b-7973-4c71-b707-17145b267996 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:34:59.323369 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-91dd512b-7973-4c71-b707-17145b267996 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:34:59.324176 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-91dd512b-7973-4c71-b707-17145b267996 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:34:59.324688 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-91dd512b-7973-4c71-b707-17145b267996 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:34:59.584033 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-91dd512b-7973-4c71-b707-17145b267996 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:34:59.594092 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-91dd512b-7973-4c71-b707-17145b267996 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac" status: 200 len: 1266 microversion: 2.1 time: 0.287005 Jul 29 05:34:59.595273 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 545/1128] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:34:59 2022] GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac => generated 1266 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:34:59.789780 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-26d45d16-6b8d-4e0b-8402-66670f67caf3 req-158afbf6-86fa-455c-83b0-dfdd5d33caa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a1829ec-d021-4713-83d5-cb35394204ac", "tag": "3a87fbe6-3f5d-46a3-909c-a495886bb451"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:34:59.805650 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-26d45d16-6b8d-4e0b-8402-66670f67caf3 req-158afbf6-86fa-455c-83b0-dfdd5d33caa1 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:34:59.806744 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-26d45d16-6b8d-4e0b-8402-66670f67caf3 req-158afbf6-86fa-455c-83b0-dfdd5d33caa1 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:34:59.830322 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-26d45d16-6b8d-4e0b-8402-66670f67caf3 req-158afbf6-86fa-455c-83b0-dfdd5d33caa1 service nova] Creating event network-changed:3a87fbe6-3f5d-46a3-909c-a495886bb451 for instance 1a1829ec-d021-4713-83d5-cb35394204ac on hv-cinder-85127 Jul 29 05:34:59.846415 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-26d45d16-6b8d-4e0b-8402-66670f67caf3 req-158afbf6-86fa-455c-83b0-dfdd5d33caa1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061042 Jul 29 05:34:59.847127 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 584/1129] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:35:00.617015 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-6d54f944-9081-4d09-8752-b534defa7ba8 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:35:00.617637 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-6d54f944-9081-4d09-8752-b534defa7ba8 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: 1a1829ec-d021-4713-83d5-cb35394204ac] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:35:00.624247 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6d54f944-9081-4d09-8752-b534defa7ba8 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:35:00.624708 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6d54f944-9081-4d09-8752-b534defa7ba8 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:35:00.625489 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6d54f944-9081-4d09-8752-b534defa7ba8 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:35:00.625936 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-6d54f944-9081-4d09-8752-b534defa7ba8 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:35:00.820123 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-6d54f944-9081-4d09-8752-b534defa7ba8 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:35:00.828494 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-6d54f944-9081-4d09-8752-b534defa7ba8 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac" status: 200 len: 1266 microversion: 2.1 time: 0.216791 Jul 29 05:35:00.829084 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 546/1130] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:35:00 2022] GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:35:01.851722 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-61a9fe39-7c3e-4859-85e3-0dac71e337e2 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:35:01.852421 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-61a9fe39-7c3e-4859-85e3-0dac71e337e2 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: 1a1829ec-d021-4713-83d5-cb35394204ac] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:35:01.858599 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-61a9fe39-7c3e-4859-85e3-0dac71e337e2 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:35:01.859047 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-61a9fe39-7c3e-4859-85e3-0dac71e337e2 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:35:01.859862 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-61a9fe39-7c3e-4859-85e3-0dac71e337e2 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:35:01.860307 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-61a9fe39-7c3e-4859-85e3-0dac71e337e2 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:35:01.995130 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-61a9fe39-7c3e-4859-85e3-0dac71e337e2 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:35:02.002740 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-61a9fe39-7c3e-4859-85e3-0dac71e337e2 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac" status: 200 len: 1266 microversion: 2.1 time: 0.156888 Jul 29 05:35:02.003305 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 585/1131] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:35:01 2022] GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:35:03.023739 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-25bd8587-e2f9-4c66-9fb0-0a97e4194a07 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:35:03.024348 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-25bd8587-e2f9-4c66-9fb0-0a97e4194a07 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: 1a1829ec-d021-4713-83d5-cb35394204ac] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:35:03.032470 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-25bd8587-e2f9-4c66-9fb0-0a97e4194a07 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:35:03.032965 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-25bd8587-e2f9-4c66-9fb0-0a97e4194a07 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:35:03.033892 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-25bd8587-e2f9-4c66-9fb0-0a97e4194a07 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:35:03.034325 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-25bd8587-e2f9-4c66-9fb0-0a97e4194a07 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:35:03.180253 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-25bd8587-e2f9-4c66-9fb0-0a97e4194a07 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:35:03.191437 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-25bd8587-e2f9-4c66-9fb0-0a97e4194a07 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac" status: 200 len: 1266 microversion: 2.1 time: 0.172305 Jul 29 05:35:03.192650 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 547/1132] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:35:03 2022] GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:35:04.213423 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-fd88e0dc-227f-4db7-94e4-ddb397810934 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:35:04.214037 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-fd88e0dc-227f-4db7-94e4-ddb397810934 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: 1a1829ec-d021-4713-83d5-cb35394204ac] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:35:04.220642 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-fd88e0dc-227f-4db7-94e4-ddb397810934 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:35:04.221095 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-fd88e0dc-227f-4db7-94e4-ddb397810934 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:35:04.221852 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-fd88e0dc-227f-4db7-94e4-ddb397810934 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:35:04.222290 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-fd88e0dc-227f-4db7-94e4-ddb397810934 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:35:04.355830 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-fd88e0dc-227f-4db7-94e4-ddb397810934 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:35:04.363270 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-fd88e0dc-227f-4db7-94e4-ddb397810934 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac" status: 200 len: 1266 microversion: 2.1 time: 0.153798 Jul 29 05:35:04.364019 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 586/1133] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:35:04 2022] GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:35:05.384068 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-5dc48ed0-57e2-4b2e-a919-0f7565ed5ed4 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:35:05.384687 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-5dc48ed0-57e2-4b2e-a919-0f7565ed5ed4 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: 1a1829ec-d021-4713-83d5-cb35394204ac] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:35:05.391199 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5dc48ed0-57e2-4b2e-a919-0f7565ed5ed4 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:35:05.391687 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5dc48ed0-57e2-4b2e-a919-0f7565ed5ed4 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:35:05.392454 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5dc48ed0-57e2-4b2e-a919-0f7565ed5ed4 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:35:05.392893 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-5dc48ed0-57e2-4b2e-a919-0f7565ed5ed4 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:35:05.526981 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-5dc48ed0-57e2-4b2e-a919-0f7565ed5ed4 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:35:05.534785 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-5dc48ed0-57e2-4b2e-a919-0f7565ed5ed4 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac" status: 200 len: 1266 microversion: 2.1 time: 0.154678 Jul 29 05:35:05.535368 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 548/1134] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:35:05 2022] GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:35:06.556840 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-6cf9132b-f90e-4583-aa91-2130e420685e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:35:06.557404 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-6cf9132b-f90e-4583-aa91-2130e420685e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: 1a1829ec-d021-4713-83d5-cb35394204ac] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:35:06.563814 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6cf9132b-f90e-4583-aa91-2130e420685e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:35:06.564246 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6cf9132b-f90e-4583-aa91-2130e420685e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:35:06.564993 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6cf9132b-f90e-4583-aa91-2130e420685e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:35:06.565419 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6cf9132b-f90e-4583-aa91-2130e420685e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:35:06.697692 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-6cf9132b-f90e-4583-aa91-2130e420685e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:35:06.705431 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-6cf9132b-f90e-4583-aa91-2130e420685e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac" status: 200 len: 1266 microversion: 2.1 time: 0.152462 Jul 29 05:35:06.706009 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 587/1135] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:35:06 2022] GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:35:07.727068 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-520656c6-ffd8-420b-a093-f343a293d1e1 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:35:07.727705 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-520656c6-ffd8-420b-a093-f343a293d1e1 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: 1a1829ec-d021-4713-83d5-cb35394204ac] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:35:07.730030 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell0:SELECT=2 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:35:07.735450 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-520656c6-ffd8-420b-a093-f343a293d1e1 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:35:07.735895 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-520656c6-ffd8-420b-a093-f343a293d1e1 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:35:07.736653 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-520656c6-ffd8-420b-a093-f343a293d1e1 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:35:07.737089 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-520656c6-ffd8-420b-a093-f343a293d1e1 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:35:07.869876 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-520656c6-ffd8-420b-a093-f343a293d1e1 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:35:07.877469 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-520656c6-ffd8-420b-a093-f343a293d1e1 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac" status: 200 len: 1266 microversion: 2.1 time: 0.154699 Jul 29 05:35:07.878026 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 549/1136] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:35:07 2022] GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:35:08.899325 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-334a7a08-feec-46c5-8185-f5c137ad8946 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:35:08.900175 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-334a7a08-feec-46c5-8185-f5c137ad8946 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: 1a1829ec-d021-4713-83d5-cb35394204ac] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:35:08.902321 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell0:SELECT=2 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:35:08.903410 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell0:SELECT=6 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:35:08.909377 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-334a7a08-feec-46c5-8185-f5c137ad8946 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:35:08.909828 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-334a7a08-feec-46c5-8185-f5c137ad8946 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:35:08.910674 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-334a7a08-feec-46c5-8185-f5c137ad8946 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:35:08.911777 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-334a7a08-feec-46c5-8185-f5c137ad8946 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:35:09.044054 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-334a7a08-feec-46c5-8185-f5c137ad8946 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:35:09.051861 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-334a7a08-feec-46c5-8185-f5c137ad8946 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac" status: 200 len: 1266 microversion: 2.1 time: 0.157590 Jul 29 05:35:09.052403 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 588/1137] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:35:08 2022] GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:35:10.073366 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-640f7d38-3205-482d-ab60-8080d3f2f1cb tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:35:10.073925 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-640f7d38-3205-482d-ab60-8080d3f2f1cb tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: 1a1829ec-d021-4713-83d5-cb35394204ac] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:35:10.081188 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-640f7d38-3205-482d-ab60-8080d3f2f1cb tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:35:10.081672 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-640f7d38-3205-482d-ab60-8080d3f2f1cb tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:35:10.082505 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-640f7d38-3205-482d-ab60-8080d3f2f1cb tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:35:10.082998 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-640f7d38-3205-482d-ab60-8080d3f2f1cb tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:35:10.225387 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-640f7d38-3205-482d-ab60-8080d3f2f1cb tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:35:10.232907 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-640f7d38-3205-482d-ab60-8080d3f2f1cb tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac" status: 200 len: 1266 microversion: 2.1 time: 0.163645 Jul 29 05:35:10.233465 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 550/1138] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:35:10 2022] GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:35:10.871399 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [req-847d1ed4-7bc8-4eef-921e-485d5f465b20 req-a24a8d05-49bf-43f1-92c5-cc5cedb5d0b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a1829ec-d021-4713-83d5-cb35394204ac", "name": "network-vif-plugged", "status": "completed", "tag": "3a87fbe6-3f5d-46a3-909c-a495886bb451"}]} {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:35:10.882581 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-847d1ed4-7bc8-4eef-921e-485d5f465b20 req-a24a8d05-49bf-43f1-92c5-cc5cedb5d0b8 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:35:10.883077 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [req-847d1ed4-7bc8-4eef-921e-485d5f465b20 req-a24a8d05-49bf-43f1-92c5-cc5cedb5d0b8 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:35:10.895157 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.compute.server_external_events [req-847d1ed4-7bc8-4eef-921e-485d5f465b20 req-a24a8d05-49bf-43f1-92c5-cc5cedb5d0b8 service nova] Creating event network-vif-plugged:3a87fbe6-3f5d-46a3-909c-a495886bb451 for instance 1a1829ec-d021-4713-83d5-cb35394204ac on hv-cinder-85127 Jul 29 05:35:10.901527 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [req-847d1ed4-7bc8-4eef-921e-485d5f465b20 req-a24a8d05-49bf-43f1-92c5-cc5cedb5d0b8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034195 Jul 29 05:35:10.902145 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 589/1139] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:35:11.253261 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-e133d9d3-0918-47da-99c8-7cada2ab54b8 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:35:11.253934 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-e133d9d3-0918-47da-99c8-7cada2ab54b8 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: 1a1829ec-d021-4713-83d5-cb35394204ac] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:35:11.261243 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e133d9d3-0918-47da-99c8-7cada2ab54b8 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:35:11.261690 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e133d9d3-0918-47da-99c8-7cada2ab54b8 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:35:11.262452 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e133d9d3-0918-47da-99c8-7cada2ab54b8 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:35:11.262886 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-e133d9d3-0918-47da-99c8-7cada2ab54b8 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:35:11.396752 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-e133d9d3-0918-47da-99c8-7cada2ab54b8 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:35:11.404613 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-e133d9d3-0918-47da-99c8-7cada2ab54b8 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac" status: 200 len: 1266 microversion: 2.1 time: 0.155233 Jul 29 05:35:11.405182 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 551/1140] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:35:11 2022] GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:35:12.426366 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-e105ff78-8506-4b8d-85d6-ac8a3cb945ba tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:35:12.427060 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-e105ff78-8506-4b8d-85d6-ac8a3cb945ba tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: 1a1829ec-d021-4713-83d5-cb35394204ac] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:35:12.433969 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e105ff78-8506-4b8d-85d6-ac8a3cb945ba tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:35:12.434425 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e105ff78-8506-4b8d-85d6-ac8a3cb945ba tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:35:12.435187 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e105ff78-8506-4b8d-85d6-ac8a3cb945ba tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:35:12.435658 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-e105ff78-8506-4b8d-85d6-ac8a3cb945ba tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:35:12.579335 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-e105ff78-8506-4b8d-85d6-ac8a3cb945ba tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:35:12.587771 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-e105ff78-8506-4b8d-85d6-ac8a3cb945ba tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac" status: 200 len: 1266 microversion: 2.1 time: 0.166056 Jul 29 05:35:12.588351 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 590/1141] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:35:12 2022] GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:35:13.608966 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-8e7fe8db-191b-4da3-bf44-700c4d405327 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:35:13.609527 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-8e7fe8db-191b-4da3-bf44-700c4d405327 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: 1a1829ec-d021-4713-83d5-cb35394204ac] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:35:13.616007 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8e7fe8db-191b-4da3-bf44-700c4d405327 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:35:13.617505 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8e7fe8db-191b-4da3-bf44-700c4d405327 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:35:13.618282 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8e7fe8db-191b-4da3-bf44-700c4d405327 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:35:13.618722 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-8e7fe8db-191b-4da3-bf44-700c4d405327 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:35:13.753156 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-8e7fe8db-191b-4da3-bf44-700c4d405327 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:35:13.761796 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-8e7fe8db-191b-4da3-bf44-700c4d405327 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac" status: 200 len: 1453 microversion: 2.1 time: 0.156825 Jul 29 05:35:13.762356 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 552/1142] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:35:13 2022] GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:35:13.782349 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-a130f852-d0c2-4c6b-ba15-2c02708326c3 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:35:13.782957 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-a130f852-d0c2-4c6b-ba15-2c02708326c3 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: 1a1829ec-d021-4713-83d5-cb35394204ac] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:35:13.790268 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a130f852-d0c2-4c6b-ba15-2c02708326c3 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:35:13.790714 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a130f852-d0c2-4c6b-ba15-2c02708326c3 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:35:13.791503 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a130f852-d0c2-4c6b-ba15-2c02708326c3 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:35:13.791934 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-a130f852-d0c2-4c6b-ba15-2c02708326c3 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:35:13.922528 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-a130f852-d0c2-4c6b-ba15-2c02708326c3 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:35:13.930776 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-a130f852-d0c2-4c6b-ba15-2c02708326c3 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac" status: 200 len: 1453 microversion: 2.1 time: 0.152554 Jul 29 05:35:13.931330 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 591/1143] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:35:13 2022] GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:35:15.848402 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-161fed22-8d5f-4db0-a890-8ade7829de40 req-dea645e2-4c74-4e74-883f-52be21c426e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a1829ec-d021-4713-83d5-cb35394204ac", "tag": "3a87fbe6-3f5d-46a3-909c-a495886bb451"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:35:15.860784 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-161fed22-8d5f-4db0-a890-8ade7829de40 req-dea645e2-4c74-4e74-883f-52be21c426e9 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:35:15.861232 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-161fed22-8d5f-4db0-a890-8ade7829de40 req-dea645e2-4c74-4e74-883f-52be21c426e9 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:35:15.873982 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-161fed22-8d5f-4db0-a890-8ade7829de40 req-dea645e2-4c74-4e74-883f-52be21c426e9 service nova] Creating event network-changed:3a87fbe6-3f5d-46a3-909c-a495886bb451 for instance 1a1829ec-d021-4713-83d5-cb35394204ac on hv-cinder-85127 Jul 29 05:35:15.879337 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-161fed22-8d5f-4db0-a890-8ade7829de40 req-dea645e2-4c74-4e74-883f-52be21c426e9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034508 Jul 29 05:35:15.880354 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 553/1144] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:36:14.300044 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 05:36:14.300824 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Fri Jul 29 05:36:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 05:36:27.646492 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 05:36:27.647094 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Fri Jul 29 05:36:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 05:36:46.019711 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:36:46.021010 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG dbcounter [-] [117821] Writing DB stats nova_cell1:SELECT=48 {{(pid=117821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:36:46.022432 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_api:SELECT=22 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:36:46.023285 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG dbcounter [-] [117820] Writing DB stats nova_cell1:SELECT=50 {{(pid=117820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:36:46.026635 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-41ea3ea0-bd1c-42fd-8a49-92dc842169e1 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:36:46.027213 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-41ea3ea0-bd1c-42fd-8a49-92dc842169e1 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: 1a1829ec-d021-4713-83d5-cb35394204ac] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:36:46.027677 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-4f608946-8f54-44a2-9930-80df86e021b8 req-727cbd57-152c-4862-a96b-eb1c48dc7f9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a1829ec-d021-4713-83d5-cb35394204ac", "tag": "3a87fbe6-3f5d-46a3-909c-a495886bb451"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:36:46.039788 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-41ea3ea0-bd1c-42fd-8a49-92dc842169e1 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:36:46.040454 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-4f608946-8f54-44a2-9930-80df86e021b8 req-727cbd57-152c-4862-a96b-eb1c48dc7f9c service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:36:46.040598 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-41ea3ea0-bd1c-42fd-8a49-92dc842169e1 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:36:46.041310 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-4f608946-8f54-44a2-9930-80df86e021b8 req-727cbd57-152c-4862-a96b-eb1c48dc7f9c service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:36:46.041638 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-41ea3ea0-bd1c-42fd-8a49-92dc842169e1 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:36:46.042293 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-41ea3ea0-bd1c-42fd-8a49-92dc842169e1 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:36:46.055591 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-4f608946-8f54-44a2-9930-80df86e021b8 req-727cbd57-152c-4862-a96b-eb1c48dc7f9c service nova] Creating event network-changed:3a87fbe6-3f5d-46a3-909c-a495886bb451 for instance 1a1829ec-d021-4713-83d5-cb35394204ac on hv-cinder-85127 Jul 29 05:36:46.062526 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-4f608946-8f54-44a2-9930-80df86e021b8 req-727cbd57-152c-4862-a96b-eb1c48dc7f9c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041244 Jul 29 05:36:46.063943 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 554/1145] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:36:46.077794 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-41ea3ea0-bd1c-42fd-8a49-92dc842169e1 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: 1a1829ec-d021-4713-83d5-cb35394204ac] Going to try to terminate instance {{(pid=117821) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 05:36:46.181960 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-41ea3ea0-bd1c-42fd-8a49-92dc842169e1 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac" status: 204 len: 0 microversion: 2.1 time: 0.164088 Jul 29 05:36:46.182941 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 592/1146] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 05:36:46 2022] DELETE /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 05:36:46.194274 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-bb392a90-215f-4553-afd0-0319b1bdd31f tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:36:46.200387 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-bb392a90-215f-4553-afd0-0319b1bdd31f tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: 1a1829ec-d021-4713-83d5-cb35394204ac] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:36:46.210135 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bb392a90-215f-4553-afd0-0319b1bdd31f tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:36:46.210668 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bb392a90-215f-4553-afd0-0319b1bdd31f tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:36:46.211710 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bb392a90-215f-4553-afd0-0319b1bdd31f tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:36:46.212152 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-bb392a90-215f-4553-afd0-0319b1bdd31f tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:36:46.461853 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-bb392a90-215f-4553-afd0-0319b1bdd31f tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:36:46.470203 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-bb392a90-215f-4553-afd0-0319b1bdd31f tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac" status: 200 len: 1577 microversion: 2.1 time: 0.280624 Jul 29 05:36:46.470781 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 555/1147] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:36:46 2022] GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac => generated 1577 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:36:47.492032 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-c365ceed-292d-4f07-b70c-b92e9960f6ec tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:36:47.492753 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-c365ceed-292d-4f07-b70c-b92e9960f6ec tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: 1a1829ec-d021-4713-83d5-cb35394204ac] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:36:47.500206 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c365ceed-292d-4f07-b70c-b92e9960f6ec tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:36:47.500656 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c365ceed-292d-4f07-b70c-b92e9960f6ec tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:36:47.501418 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c365ceed-292d-4f07-b70c-b92e9960f6ec tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:36:47.501855 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-c365ceed-292d-4f07-b70c-b92e9960f6ec tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:36:47.695820 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-c365ceed-292d-4f07-b70c-b92e9960f6ec tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:36:47.703841 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-c365ceed-292d-4f07-b70c-b92e9960f6ec tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac" status: 200 len: 1577 microversion: 2.1 time: 0.215976 Jul 29 05:36:47.704739 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 593/1148] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:36:47 2022] GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac => generated 1577 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:36:48.266078 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-c492b378-023b-4e55-85e3-936b40a1c8e6 req-8e840a09-6874-498d-bbfb-d4f5c8581579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a1829ec-d021-4713-83d5-cb35394204ac", "name": "network-vif-deleted", "tag": "3a87fbe6-3f5d-46a3-909c-a495886bb451"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:36:48.279330 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-c492b378-023b-4e55-85e3-936b40a1c8e6 req-8e840a09-6874-498d-bbfb-d4f5c8581579 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:36:48.279813 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-c492b378-023b-4e55-85e3-936b40a1c8e6 req-8e840a09-6874-498d-bbfb-d4f5c8581579 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:36:48.295583 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-c492b378-023b-4e55-85e3-936b40a1c8e6 req-8e840a09-6874-498d-bbfb-d4f5c8581579 service nova] Creating event network-vif-deleted:3a87fbe6-3f5d-46a3-909c-a495886bb451 for instance 1a1829ec-d021-4713-83d5-cb35394204ac on hv-cinder-85127 Jul 29 05:36:48.302492 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-c492b378-023b-4e55-85e3-936b40a1c8e6 req-8e840a09-6874-498d-bbfb-d4f5c8581579 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039734 Jul 29 05:36:48.303492 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 556/1149] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:36:48.725287 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-7fa4e210-0071-4636-9bfe-5b4dca35ec09 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:36:48.725977 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-7fa4e210-0071-4636-9bfe-5b4dca35ec09 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: 1a1829ec-d021-4713-83d5-cb35394204ac] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:36:48.732509 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7fa4e210-0071-4636-9bfe-5b4dca35ec09 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:36:48.732960 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7fa4e210-0071-4636-9bfe-5b4dca35ec09 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:36:48.733796 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7fa4e210-0071-4636-9bfe-5b4dca35ec09 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:36:48.734804 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7fa4e210-0071-4636-9bfe-5b4dca35ec09 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:36:48.769106 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7fa4e210-0071-4636-9bfe-5b4dca35ec09 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:36:48.769548 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7fa4e210-0071-4636-9bfe-5b4dca35ec09 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:36:48.769995 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.objects.instance [None req-7fa4e210-0071-4636-9bfe-5b4dca35ec09 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lazy-loading 'fault' on Instance uuid 1a1829ec-d021-4713-83d5-cb35394204ac {{(pid=117821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:36:48.810280 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-7fa4e210-0071-4636-9bfe-5b4dca35ec09 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:36:48.819022 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-7fa4e210-0071-4636-9bfe-5b4dca35ec09 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac" status: 200 len: 1231 microversion: 2.1 time: 0.097647 Jul 29 05:36:48.819630 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 594/1150] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:36:48 2022] GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac => generated 1231 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:36:49.841838 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-07486752-2bb9-46b4-8c23-fe47959ac472 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:36:49.842527 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-07486752-2bb9-46b4-8c23-fe47959ac472 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: 1a1829ec-d021-4713-83d5-cb35394204ac] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:36:49.849924 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-07486752-2bb9-46b4-8c23-fe47959ac472 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:36:49.850374 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-07486752-2bb9-46b4-8c23-fe47959ac472 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:36:49.851129 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-07486752-2bb9-46b4-8c23-fe47959ac472 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:36:49.851596 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-07486752-2bb9-46b4-8c23-fe47959ac472 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:36:49.864658 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.wsgi [None req-07486752-2bb9-46b4-8c23-fe47959ac472 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] HTTP exception thrown: Instance 1a1829ec-d021-4713-83d5-cb35394204ac could not be found. Jul 29 05:36:49.866396 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-07486752-2bb9-46b4-8c23-fe47959ac472 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Request method failure captured: Jul 29 05:36:49.866396 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: request: GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac HTTP/1.1 Jul 29 05:36:49.866396 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept: application/json Jul 29 05:36:49.866396 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept-Encoding: identity Jul 29 05:36:49.866396 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Connection: close Jul 29 05:36:49.866396 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Length: 0 Jul 29 05:36:49.866396 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Type: application/json Jul 29 05:36:49.866396 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Host: 10.222.0.49 Jul 29 05:36:49.866396 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Openstack-System-Scope: None Jul 29 05:36:49.866396 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: User-Agent: python-urllib3/1.26.10 Jul 29 05:36:49.866396 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Auth-Token: gAAAAABi43BuZp0AKwuW9Qu0O3_B2H56iyuAy9HSmssayuPJ5ki_Eb4B0AT314uMBZsesWB0kyeUx0qqsxoMEB3JnKsVatKWKwYLiESsrcCfJfFORtsxZbvlTbr7eqsZOBs3CRHj8v7WNaqjxt__Q_pgP9gFbBu4WOb6T8OAyFNc4t1SMfqZmcA Jul 29 05:36:49.866396 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Id: None Jul 29 05:36:49.866396 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Name: None Jul 29 05:36:49.866396 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Identity-Status: Confirmed Jul 29 05:36:49.866396 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Is-Admin-Project: True Jul 29 05:36:49.866396 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Id: default Jul 29 05:36:49.866396 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Name: Default Jul 29 05:36:49.866396 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Id: 3d61aa3cfb59443d849c3d09d839cff5 Jul 29 05:36:49.866396 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Name: tempest-TestVolumeBootPattern-421021144 Jul 29 05:36:49.866396 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Role: member,reader Jul 29 05:36:49.866396 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Roles: member,reader Jul 29 05:36:49.868215 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3d61aa3cfb59443d849c3d09d839cff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3d61aa3cfb59443d849c3d09d839cff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3d61aa3cfb59443d849c3d09d839cff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3d61aa3cfb59443d849c3d09d839cff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:36:49.868215 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant: tempest-TestVolumeBootPattern-421021144 Jul 29 05:36:49.868215 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Id: 3d61aa3cfb59443d849c3d09d839cff5 Jul 29 05:36:49.868215 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Name: tempest-TestVolumeBootPattern-421021144 Jul 29 05:36:49.868215 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User: tempest-TestVolumeBootPattern-421021144-project Jul 29 05:36:49.868215 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Id: default Jul 29 05:36:49.868215 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Name: Default Jul 29 05:36:49.868215 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Id: 984ce8ca6aac41eab2c998c17d3820c5 Jul 29 05:36:49.868215 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Name: tempest-TestVolumeBootPattern-421021144-project Jul 29 05:36:49.868215 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: method: > Jul 29 05:36:49.868215 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: exception: Instance 1a1829ec-d021-4713-83d5-cb35394204ac could not be found. Jul 29 05:36:49.868215 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: action_args: {'id': '1a1829ec-d021-4713-83d5-cb35394204ac'} Jul 29 05:36:49.869191 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:36:49.869191 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:36:49.869191 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:36:49.869191 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:36:49.869191 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:36:49.869191 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:36:49.869191 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:36:49.869191 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:36:49.869191 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:36:49.869191 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:36:49.869191 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a1829ec-d021-4713-83d5-cb35394204ac could not be found. Jul 29 05:36:49.869191 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:36:49.869191 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:36:49.869191 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:36:49.869191 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:36:49.869191 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:36:49.869191 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:36:49.869191 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:36:49.869191 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:36:49.869191 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:36:49.870633 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:36:49.870633 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:36:49.870633 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:36:49.870633 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:36:49.870633 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:36:49.870633 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:36:49.870633 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:36:49.870633 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a1829ec-d021-4713-83d5-cb35394204ac could not be found. Jul 29 05:36:49.870633 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:36:49.870633 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:36:49.870633 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:36:49.870633 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:36:49.870633 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:36:49.870633 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:36:49.870633 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:36:49.870633 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:36:49.870633 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a1829ec-d021-4713-83d5-cb35394204ac could not be found. Jul 29 05:36:49.870633 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:36:49.871963 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-07486752-2bb9-46b4-8c23-fe47959ac472 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Returning 404 to user: Instance 1a1829ec-d021-4713-83d5-cb35394204ac could not be found. {{(pid=117820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:36:49.871963 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-07486752-2bb9-46b4-8c23-fe47959ac472 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac" status: 404 len: 111 microversion: 2.1 time: 0.030160 Jul 29 05:36:49.871963 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 557/1151] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:36:49 2022] GET /compute/v2.1/servers/1a1829ec-d021-4713-83d5-cb35394204ac => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:36:52.953780 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-672870d6-425c-4b84-805e-e138a33c9b3e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:36:52.954512 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-672870d6-425c-4b84-805e-e138a33c9b3e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: ca4c859c-f307-446f-91a3-967c6ccf6afd] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:36:52.963414 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-d323af86-e8c1-40c8-aecf-0c5d26055f44 req-776a4031-de86-4437-bf66-88434a542e2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca4c859c-f307-446f-91a3-967c6ccf6afd", "tag": "99dc50ec-fe52-4053-870a-860015fe3269"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:36:52.972171 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-672870d6-425c-4b84-805e-e138a33c9b3e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:36:52.973268 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-672870d6-425c-4b84-805e-e138a33c9b3e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:36:52.974065 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-672870d6-425c-4b84-805e-e138a33c9b3e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:36:52.974505 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-672870d6-425c-4b84-805e-e138a33c9b3e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:36:52.979508 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-d323af86-e8c1-40c8-aecf-0c5d26055f44 req-776a4031-de86-4437-bf66-88434a542e2f service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:36:52.979739 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-d323af86-e8c1-40c8-aecf-0c5d26055f44 req-776a4031-de86-4437-bf66-88434a542e2f service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:36:52.992285 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-d323af86-e8c1-40c8-aecf-0c5d26055f44 req-776a4031-de86-4437-bf66-88434a542e2f service nova] Creating event network-changed:99dc50ec-fe52-4053-870a-860015fe3269 for instance ca4c859c-f307-446f-91a3-967c6ccf6afd on hv-cinder-85127 Jul 29 05:36:52.997550 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-d323af86-e8c1-40c8-aecf-0c5d26055f44 req-776a4031-de86-4437-bf66-88434a542e2f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037761 Jul 29 05:36:52.998649 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 558/1152] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:36:53.003232 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-672870d6-425c-4b84-805e-e138a33c9b3e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: ca4c859c-f307-446f-91a3-967c6ccf6afd] Going to try to terminate instance {{(pid=117821) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 05:36:53.089027 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-672870d6-425c-4b84-805e-e138a33c9b3e tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd" status: 204 len: 0 microversion: 2.1 time: 0.138919 Jul 29 05:36:53.089818 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 595/1153] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 05:36:52 2022] DELETE /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 05:36:53.101628 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-0bf0e11a-25fe-4ce8-b508-37896f0ef4ef tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:36:53.102339 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-0bf0e11a-25fe-4ce8-b508-37896f0ef4ef tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: ca4c859c-f307-446f-91a3-967c6ccf6afd] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:36:53.109986 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0bf0e11a-25fe-4ce8-b508-37896f0ef4ef tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:36:53.111033 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0bf0e11a-25fe-4ce8-b508-37896f0ef4ef tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:36:53.112026 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0bf0e11a-25fe-4ce8-b508-37896f0ef4ef tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:36:53.112486 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-0bf0e11a-25fe-4ce8-b508-37896f0ef4ef tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:36:53.277214 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.policy [None req-0bf0e11a-25fe-4ce8-b508-37896f0ef4ef tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:36:53.285590 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-0bf0e11a-25fe-4ce8-b508-37896f0ef4ef tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd" status: 200 len: 1578 microversion: 2.1 time: 0.189196 Jul 29 05:36:53.286164 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 559/1154] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:36:53 2022] GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd => generated 1578 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:36:54.308132 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-0c1cd853-af09-4fa6-a753-d25628ecda1c tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:36:54.309014 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-0c1cd853-af09-4fa6-a753-d25628ecda1c tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: ca4c859c-f307-446f-91a3-967c6ccf6afd] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:36:54.316154 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0c1cd853-af09-4fa6-a753-d25628ecda1c tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:36:54.316623 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0c1cd853-af09-4fa6-a753-d25628ecda1c tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:36:54.317378 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0c1cd853-af09-4fa6-a753-d25628ecda1c tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:36:54.317815 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-0c1cd853-af09-4fa6-a753-d25628ecda1c tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:36:54.453964 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-0c1cd853-af09-4fa6-a753-d25628ecda1c tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:36:54.461870 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-0c1cd853-af09-4fa6-a753-d25628ecda1c tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd" status: 200 len: 1578 microversion: 2.1 time: 0.158304 Jul 29 05:36:54.462439 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 596/1155] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:36:54 2022] GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:36:55.268710 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [req-6cd10c7f-24bf-4baa-a47a-8f35ef8fbecb req-1fab59ec-8e13-4079-aca9-ad01e20aed88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca4c859c-f307-446f-91a3-967c6ccf6afd", "name": "network-vif-deleted", "tag": "99dc50ec-fe52-4053-870a-860015fe3269"}]} {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:36:55.280921 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-6cd10c7f-24bf-4baa-a47a-8f35ef8fbecb req-1fab59ec-8e13-4079-aca9-ad01e20aed88 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:36:55.281361 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [req-6cd10c7f-24bf-4baa-a47a-8f35ef8fbecb req-1fab59ec-8e13-4079-aca9-ad01e20aed88 service nova] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:36:55.294597 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.compute.server_external_events [req-6cd10c7f-24bf-4baa-a47a-8f35ef8fbecb req-1fab59ec-8e13-4079-aca9-ad01e20aed88 service nova] Creating event network-vif-deleted:99dc50ec-fe52-4053-870a-860015fe3269 for instance ca4c859c-f307-446f-91a3-967c6ccf6afd on hv-cinder-85127 Jul 29 05:36:55.299842 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [req-6cd10c7f-24bf-4baa-a47a-8f35ef8fbecb req-1fab59ec-8e13-4079-aca9-ad01e20aed88 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035320 Jul 29 05:36:55.300451 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 560/1156] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 05:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:36:55.482964 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-7f93b52e-66ee-47d9-8879-245162f4d8f8 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:36:55.483527 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-7f93b52e-66ee-47d9-8879-245162f4d8f8 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: ca4c859c-f307-446f-91a3-967c6ccf6afd] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:36:55.490099 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7f93b52e-66ee-47d9-8879-245162f4d8f8 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:36:55.490546 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7f93b52e-66ee-47d9-8879-245162f4d8f8 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:36:55.491309 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7f93b52e-66ee-47d9-8879-245162f4d8f8 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:36:55.491770 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-7f93b52e-66ee-47d9-8879-245162f4d8f8 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:36:55.564558 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.policy [None req-7f93b52e-66ee-47d9-8879-245162f4d8f8 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984ce8ca6aac41eab2c998c17d3820c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d61aa3cfb59443d849c3d09d839cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:36:55.572554 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-7f93b52e-66ee-47d9-8879-245162f4d8f8 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd" status: 200 len: 1226 microversion: 2.1 time: 0.093523 Jul 29 05:36:55.573447 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 597/1157] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:36:55 2022] GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:36:56.595816 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-345cfcb1-779d-4b2d-b363-037583358e3d tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:36:56.596424 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-345cfcb1-779d-4b2d-b363-037583358e3d tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: ca4c859c-f307-446f-91a3-967c6ccf6afd] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:36:56.603706 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-345cfcb1-779d-4b2d-b363-037583358e3d tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:36:56.604167 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-345cfcb1-779d-4b2d-b363-037583358e3d tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:36:56.604936 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-345cfcb1-779d-4b2d-b363-037583358e3d tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:36:56.605378 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-345cfcb1-779d-4b2d-b363-037583358e3d tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:36:56.618612 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.wsgi [None req-345cfcb1-779d-4b2d-b363-037583358e3d tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] HTTP exception thrown: Instance ca4c859c-f307-446f-91a3-967c6ccf6afd could not be found. Jul 29 05:36:56.620254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-345cfcb1-779d-4b2d-b363-037583358e3d tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Request method failure captured: Jul 29 05:36:56.620254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: request: GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd HTTP/1.1 Jul 29 05:36:56.620254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept: application/json Jul 29 05:36:56.620254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept-Encoding: identity Jul 29 05:36:56.620254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Connection: close Jul 29 05:36:56.620254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Length: 0 Jul 29 05:36:56.620254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Type: application/json Jul 29 05:36:56.620254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Host: 10.222.0.49 Jul 29 05:36:56.620254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Openstack-System-Scope: None Jul 29 05:36:56.620254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: User-Agent: python-urllib3/1.26.10 Jul 29 05:36:56.620254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Auth-Token: gAAAAABi43BuZp0AKwuW9Qu0O3_B2H56iyuAy9HSmssayuPJ5ki_Eb4B0AT314uMBZsesWB0kyeUx0qqsxoMEB3JnKsVatKWKwYLiESsrcCfJfFORtsxZbvlTbr7eqsZOBs3CRHj8v7WNaqjxt__Q_pgP9gFbBu4WOb6T8OAyFNc4t1SMfqZmcA Jul 29 05:36:56.620254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Id: None Jul 29 05:36:56.620254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Name: None Jul 29 05:36:56.620254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Identity-Status: Confirmed Jul 29 05:36:56.620254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Is-Admin-Project: True Jul 29 05:36:56.620254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Id: default Jul 29 05:36:56.620254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Name: Default Jul 29 05:36:56.620254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Id: 3d61aa3cfb59443d849c3d09d839cff5 Jul 29 05:36:56.620254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Name: tempest-TestVolumeBootPattern-421021144 Jul 29 05:36:56.620254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Role: member,reader Jul 29 05:36:56.620254 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Roles: member,reader Jul 29 05:36:56.621936 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3d61aa3cfb59443d849c3d09d839cff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3d61aa3cfb59443d849c3d09d839cff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3d61aa3cfb59443d849c3d09d839cff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3d61aa3cfb59443d849c3d09d839cff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:36:56.621936 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant: tempest-TestVolumeBootPattern-421021144 Jul 29 05:36:56.621936 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Id: 3d61aa3cfb59443d849c3d09d839cff5 Jul 29 05:36:56.621936 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Name: tempest-TestVolumeBootPattern-421021144 Jul 29 05:36:56.621936 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User: tempest-TestVolumeBootPattern-421021144-project Jul 29 05:36:56.621936 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Id: default Jul 29 05:36:56.621936 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Name: Default Jul 29 05:36:56.621936 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Id: 984ce8ca6aac41eab2c998c17d3820c5 Jul 29 05:36:56.621936 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Name: tempest-TestVolumeBootPattern-421021144-project Jul 29 05:36:56.621936 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: method: > Jul 29 05:36:56.621936 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: exception: Instance ca4c859c-f307-446f-91a3-967c6ccf6afd could not be found. Jul 29 05:36:56.621936 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: action_args: {'id': 'ca4c859c-f307-446f-91a3-967c6ccf6afd'} Jul 29 05:36:56.623044 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:36:56.623044 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:36:56.623044 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:36:56.623044 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:36:56.623044 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:36:56.623044 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:36:56.623044 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:36:56.623044 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:36:56.623044 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:36:56.623044 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:36:56.623044 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca4c859c-f307-446f-91a3-967c6ccf6afd could not be found. Jul 29 05:36:56.623044 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:36:56.623044 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:36:56.623044 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:36:56.623044 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:36:56.623044 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:36:56.623044 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:36:56.623044 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:36:56.623044 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:36:56.623044 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:36:56.624642 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:36:56.624642 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:36:56.624642 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:36:56.624642 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:36:56.624642 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:36:56.624642 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:36:56.624642 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:36:56.624642 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca4c859c-f307-446f-91a3-967c6ccf6afd could not be found. Jul 29 05:36:56.624642 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:36:56.624642 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:36:56.624642 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:36:56.624642 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:36:56.624642 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:36:56.624642 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:36:56.624642 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:36:56.624642 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:36:56.624642 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca4c859c-f307-446f-91a3-967c6ccf6afd could not be found. Jul 29 05:36:56.624642 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:36:56.626194 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-345cfcb1-779d-4b2d-b363-037583358e3d tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Returning 404 to user: Instance ca4c859c-f307-446f-91a3-967c6ccf6afd could not be found. {{(pid=117820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:36:56.626194 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-345cfcb1-779d-4b2d-b363-037583358e3d tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd" status: 404 len: 111 microversion: 2.1 time: 0.030894 Jul 29 05:36:56.626194 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 561/1158] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:36:56 2022] GET /compute/v2.1/servers/ca4c859c-f307-446f-91a3-967c6ccf6afd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:36:57.068352 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-6518dc1a-de00-4217-b88e-8bc60dc459e0 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:36:57.068925 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.compute.api [None req-6518dc1a-de00-4217-b88e-8bc60dc459e0 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: cf290482-2215-4471-b672-b5f997b34352] Fetching instance by UUID {{(pid=117821) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:36:57.075520 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6518dc1a-de00-4217-b88e-8bc60dc459e0 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:36:57.075975 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6518dc1a-de00-4217-b88e-8bc60dc459e0 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:36:57.076740 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6518dc1a-de00-4217-b88e-8bc60dc459e0 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:36:57.077178 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG oslo_concurrency.lockutils [None req-6518dc1a-de00-4217-b88e-8bc60dc459e0 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:36:57.091883 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.wsgi [None req-6518dc1a-de00-4217-b88e-8bc60dc459e0 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] HTTP exception thrown: Instance cf290482-2215-4471-b672-b5f997b34352 could not be found. Jul 29 05:36:57.093554 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-6518dc1a-de00-4217-b88e-8bc60dc459e0 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Request method failure captured: Jul 29 05:36:57.093554 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: request: DELETE /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352 HTTP/1.1 Jul 29 05:36:57.093554 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept: application/json Jul 29 05:36:57.093554 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Accept-Encoding: identity Jul 29 05:36:57.093554 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Connection: close Jul 29 05:36:57.093554 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Length: 0 Jul 29 05:36:57.093554 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Content-Type: application/json Jul 29 05:36:57.093554 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Host: 10.222.0.49 Jul 29 05:36:57.093554 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Openstack-System-Scope: None Jul 29 05:36:57.093554 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: User-Agent: python-urllib3/1.26.10 Jul 29 05:36:57.093554 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Auth-Token: gAAAAABi43BuZp0AKwuW9Qu0O3_B2H56iyuAy9HSmssayuPJ5ki_Eb4B0AT314uMBZsesWB0kyeUx0qqsxoMEB3JnKsVatKWKwYLiESsrcCfJfFORtsxZbvlTbr7eqsZOBs3CRHj8v7WNaqjxt__Q_pgP9gFbBu4WOb6T8OAyFNc4t1SMfqZmcA Jul 29 05:36:57.093554 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Id: None Jul 29 05:36:57.093554 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Domain-Name: None Jul 29 05:36:57.093554 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Identity-Status: Confirmed Jul 29 05:36:57.093554 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Is-Admin-Project: True Jul 29 05:36:57.093554 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Id: default Jul 29 05:36:57.093554 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Domain-Name: Default Jul 29 05:36:57.093554 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Id: 3d61aa3cfb59443d849c3d09d839cff5 Jul 29 05:36:57.093554 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Project-Name: tempest-TestVolumeBootPattern-421021144 Jul 29 05:36:57.093554 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Role: member,reader Jul 29 05:36:57.093554 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Roles: member,reader Jul 29 05:36:57.095317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3d61aa3cfb59443d849c3d09d839cff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3d61aa3cfb59443d849c3d09d839cff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3d61aa3cfb59443d849c3d09d839cff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3d61aa3cfb59443d849c3d09d839cff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:36:57.095317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant: tempest-TestVolumeBootPattern-421021144 Jul 29 05:36:57.095317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Id: 3d61aa3cfb59443d849c3d09d839cff5 Jul 29 05:36:57.095317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-Tenant-Name: tempest-TestVolumeBootPattern-421021144 Jul 29 05:36:57.095317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User: tempest-TestVolumeBootPattern-421021144-project Jul 29 05:36:57.095317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Id: default Jul 29 05:36:57.095317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Domain-Name: Default Jul 29 05:36:57.095317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Id: 984ce8ca6aac41eab2c998c17d3820c5 Jul 29 05:36:57.095317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: X-User-Name: tempest-TestVolumeBootPattern-421021144-project Jul 29 05:36:57.095317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: method: > Jul 29 05:36:57.095317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: exception: Instance cf290482-2215-4471-b672-b5f997b34352 could not be found. Jul 29 05:36:57.095317 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: action_args: {'id': 'cf290482-2215-4471-b672-b5f997b34352'} Jul 29 05:36:57.096389 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:36:57.096389 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:36:57.096389 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:36:57.096389 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:36:57.096389 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:36:57.096389 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:36:57.096389 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:36:57.096389 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:36:57.096389 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:36:57.096389 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:36:57.096389 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf290482-2215-4471-b672-b5f997b34352 could not be found. Jul 29 05:36:57.096389 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:36:57.096389 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:36:57.096389 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:36:57.096389 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:36:57.096389 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:36:57.096389 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:36:57.096389 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:36:57.096389 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:36:57.096389 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:36:57.098148 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:36:57.098148 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 05:36:57.098148 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 05:36:57.098148 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 05:36:57.098148 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 05:36:57.098148 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:36:57.098148 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:36:57.098148 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:36:57.098148 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:36:57.098148 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf290482-2215-4471-b672-b5f997b34352 could not be found. Jul 29 05:36:57.098148 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:36:57.098148 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:36:57.098148 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:36:57.098148 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:36:57.098148 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:36:57.098148 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:36:57.098148 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:36:57.098148 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:36:57.098148 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf290482-2215-4471-b672-b5f997b34352 could not be found. Jul 29 05:36:57.098148 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: ERROR nova.api.openstack.wsgi Jul 29 05:36:57.099972 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-6518dc1a-de00-4217-b88e-8bc60dc459e0 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Returning 404 to user: Instance cf290482-2215-4471-b672-b5f997b34352 could not be found. {{(pid=117821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:36:57.099972 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-6518dc1a-de00-4217-b88e-8bc60dc459e0 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "DELETE /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352" status: 404 len: 111 microversion: 2.1 time: 0.031896 Jul 29 05:36:57.099972 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 598/1159] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 05:36:57 2022] DELETE /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:36:57.104630 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-d852df6a-ffae-45a9-898f-0344a53a6045 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '>' {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:36:57.105238 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.compute.api [None req-d852df6a-ffae-45a9-898f-0344a53a6045 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] [instance: cf290482-2215-4471-b672-b5f997b34352] Fetching instance by UUID {{(pid=117820) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:36:57.111315 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d852df6a-ffae-45a9-898f-0344a53a6045 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:36:57.111788 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d852df6a-ffae-45a9-898f-0344a53a6045 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:36:57.112622 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d852df6a-ffae-45a9-898f-0344a53a6045 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:36:57.112977 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG oslo_concurrency.lockutils [None req-d852df6a-ffae-45a9-898f-0344a53a6045 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Lock "dee2e7f6-cf50-4b99-b852-8b6cbd53f4f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:36:57.126841 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.wsgi [None req-d852df6a-ffae-45a9-898f-0344a53a6045 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] HTTP exception thrown: Instance cf290482-2215-4471-b672-b5f997b34352 could not be found. Jul 29 05:36:57.128368 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-d852df6a-ffae-45a9-898f-0344a53a6045 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Request method failure captured: Jul 29 05:36:57.128368 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: request: GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352 HTTP/1.1 Jul 29 05:36:57.128368 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept: application/json Jul 29 05:36:57.128368 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Accept-Encoding: identity Jul 29 05:36:57.128368 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Connection: close Jul 29 05:36:57.128368 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Length: 0 Jul 29 05:36:57.128368 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Content-Type: application/json Jul 29 05:36:57.128368 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Host: 10.222.0.49 Jul 29 05:36:57.128368 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Openstack-System-Scope: None Jul 29 05:36:57.128368 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: User-Agent: python-urllib3/1.26.10 Jul 29 05:36:57.128368 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Auth-Token: gAAAAABi43BuZp0AKwuW9Qu0O3_B2H56iyuAy9HSmssayuPJ5ki_Eb4B0AT314uMBZsesWB0kyeUx0qqsxoMEB3JnKsVatKWKwYLiESsrcCfJfFORtsxZbvlTbr7eqsZOBs3CRHj8v7WNaqjxt__Q_pgP9gFbBu4WOb6T8OAyFNc4t1SMfqZmcA Jul 29 05:36:57.128368 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Id: None Jul 29 05:36:57.128368 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Domain-Name: None Jul 29 05:36:57.128368 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Identity-Status: Confirmed Jul 29 05:36:57.128368 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Is-Admin-Project: True Jul 29 05:36:57.128368 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Id: default Jul 29 05:36:57.128368 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Domain-Name: Default Jul 29 05:36:57.128368 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Id: 3d61aa3cfb59443d849c3d09d839cff5 Jul 29 05:36:57.128368 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Project-Name: tempest-TestVolumeBootPattern-421021144 Jul 29 05:36:57.128368 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Role: member,reader Jul 29 05:36:57.128368 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Roles: member,reader Jul 29 05:36:57.130036 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3d61aa3cfb59443d849c3d09d839cff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3d61aa3cfb59443d849c3d09d839cff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3d61aa3cfb59443d849c3d09d839cff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3d61aa3cfb59443d849c3d09d839cff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 29 05:36:57.130036 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant: tempest-TestVolumeBootPattern-421021144 Jul 29 05:36:57.130036 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Id: 3d61aa3cfb59443d849c3d09d839cff5 Jul 29 05:36:57.130036 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-Tenant-Name: tempest-TestVolumeBootPattern-421021144 Jul 29 05:36:57.130036 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User: tempest-TestVolumeBootPattern-421021144-project Jul 29 05:36:57.130036 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Id: default Jul 29 05:36:57.130036 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Domain-Name: Default Jul 29 05:36:57.130036 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Id: 984ce8ca6aac41eab2c998c17d3820c5 Jul 29 05:36:57.130036 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: X-User-Name: tempest-TestVolumeBootPattern-421021144-project Jul 29 05:36:57.130036 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: method: > Jul 29 05:36:57.130036 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: exception: Instance cf290482-2215-4471-b672-b5f997b34352 could not be found. Jul 29 05:36:57.130036 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: action_args: {'id': 'cf290482-2215-4471-b672-b5f997b34352'} Jul 29 05:36:57.130977 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: {{(pid=117820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:36:57.130977 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:36:57.130977 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:36:57.130977 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:36:57.130977 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:36:57.130977 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:36:57.130977 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:36:57.130977 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:36:57.130977 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:36:57.130977 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:36:57.130977 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf290482-2215-4471-b672-b5f997b34352 could not be found. Jul 29 05:36:57.130977 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:36:57.130977 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:36:57.130977 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:36:57.130977 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:36:57.130977 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:36:57.130977 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:36:57.130977 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:36:57.130977 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:36:57.130977 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:36:57.132565 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:36:57.132565 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:36:57.132565 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:36:57.132565 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:36:57.132565 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:36:57.132565 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:36:57.132565 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:36:57.132565 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf290482-2215-4471-b672-b5f997b34352 could not be found. Jul 29 05:36:57.132565 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:36:57.132565 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:36:57.132565 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:36:57.132565 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:36:57.132565 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:36:57.132565 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:36:57.132565 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:36:57.132565 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:36:57.132565 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf290482-2215-4471-b672-b5f997b34352 could not be found. Jul 29 05:36:57.132565 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: ERROR nova.api.openstack.wsgi Jul 29 05:36:57.133926 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: DEBUG nova.api.openstack.wsgi [None req-d852df6a-ffae-45a9-898f-0344a53a6045 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Returning 404 to user: Instance cf290482-2215-4471-b672-b5f997b34352 could not be found. {{(pid=117820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:36:57.133926 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO nova.api.openstack.requestlog [None req-d852df6a-ffae-45a9-898f-0344a53a6045 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352" status: 404 len: 111 microversion: 2.1 time: 0.029210 Jul 29 05:36:57.133926 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: [pid: 117820|app: 0|req: 562/1160] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 05:36:57 2022] GET /compute/v2.1/servers/cf290482-2215-4471-b672-b5f997b34352 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 05:36:58.430754 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: DEBUG nova.api.openstack.wsgi [None req-dff58c68-566d-48e4-b6a4-8babf14009e4 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] Calling method '.version_select at 0x7fa6400551f0>' {{(pid=117821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:36:58.455516 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO nova.api.openstack.requestlog [None req-dff58c68-566d-48e4-b6a4-8babf14009e4 tempest-TestVolumeBootPattern-421021144 tempest-TestVolumeBootPattern-421021144-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1886222899" status: 202 len: 0 microversion: 2.1 time: 0.028458 Jul 29 05:36:58.456312 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: [pid: 117821|app: 0|req: 599/1161] 10.222.0.49 () {58 vars in 1263 bytes} [Fri Jul 29 05:36:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1886222899 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 05:38:01.600245 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 05:38:01.600835 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Fri Jul 29 05:38:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 05:38:04.547528 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 05:38:04.548147 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Fri Jul 29 05:38:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 05:39:34.308619 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 05:39:34.309252 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Fri Jul 29 05:39:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 05:39:47.656322 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 05:39:47.656991 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Fri Jul 29 05:39:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 05:40:03.874965 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 05:40:03.875465 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Fri Jul 29 05:40:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 05:41:21.608631 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 05:41:21.609201 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Fri Jul 29 05:41:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 05:41:24.556455 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 05:41:24.557057 dv-cinder-851279-2-iscsi devstack@n-api.service[117821]: Fri Jul 29 05:41:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 05:41:55.526464 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 05:41:55.527308 dv-cinder-851279-2-iscsi devstack@n-api.service[117820]: Fri Jul 29 05:41:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!